Apr 10 10:25:50 devstack cinder-volume[73355]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 10:25:50 devstack cinder-volume[73355]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:25:50 devstack cinder-volume[73355]: we strongly recommend against using it for new projects. Apr 10 10:25:50 devstack cinder-volume[73355]: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:25:50 devstack cinder-volume[73355]: framework. For more detail see Apr 10 10:25:50 devstack cinder-volume[73355]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:25:50 devstack cinder-volume[73355]: import eventlet # noqa Apr 10 10:25:52 devstack cinder-volume[73355]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73355) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:25:52 devstack cinder-volume[73355]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73355) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:25:52 devstack cinder-volume[73355]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73355) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:25:52 devstack cinder-volume[73355]: INFO dbcounter [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Registered counter for database cinder Apr 10 10:25:52 devstack cinder-volume[73355]: DEBUG oslo_db.sqlalchemy.engines [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73355) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:25:52 devstack cinder-volume[73355]: DEBUG dbcounter [-] [73355] Writer thread running {{(pid=73355) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:25:52 devstack cinder-volume[73355]: INFO cinder.rpc [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 10:25:52 devstack cinder-volume[73355]: INFO cinder.rpc [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 10:25:52 devstack cinder-volume[73355]: DEBUG oslo_db.sqlalchemy.engines [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73355) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:25:52 devstack cinder-volume[73355]: INFO cinder.volume.manager [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Determined volume DB was empty at startup. Apr 10 10:25:52 devstack cinder-volume[73355]: DEBUG cinder.volume.manager [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73355) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 10:25:52 devstack cinder-volume[73355]: INFO cinder.volume.manager [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 10:25:52 devstack cinder-volume[73355]: WARNING stevedore.named [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:25:52 devstack cinder-volume[73355]: WARNING castellan.key_manager [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:25:53 devstack cinder-volume[73355]: WARNING cinder.keymgr.conf_key_mgr [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG cinder.volume.drivers.lvm [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73355) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_concurrency.processutils [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73355) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_concurrency.processutils [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] CMD "cinder-rtstool verify" returned: 0 in 0.249s {{(pid=73355) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_db.sqlalchemy.engines [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73355) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:25:53 devstack cinder-volume[73355]: INFO cinder.rpc [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 10 10:25:53 devstack cinder-volume[73355]: INFO cinder.rpc [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 10 10:25:53 devstack cinder-volume[73355]: WARNING stevedore.named [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:25:53 devstack cinder-volume[73355]: WARNING castellan.key_manager [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:25:53 devstack cinder-volume[73355]: INFO cinder.volume.manager [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_db.sqlalchemy.engines [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73355) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:25:53 devstack cinder-volume[73355]: INFO oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Starting 1 workers Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Started child 73455 {{(pid=73355) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Full set of CONF: {{(pid=73355) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] ******************************************************************************** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Configuration options gathered from: {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] ================================================================================ {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] allow_availability_zone_fallback = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] allow_compression_on_image_upload = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] allowed_direct_url_schemes = [] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] api_rate_limit = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] auth_strategy = keystone {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] az_cache_duration = 3600 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_availability_zone = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_host = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_name = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_stats_polling_interval = 60 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backup_api_class = cinder.backup.api.API {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backup_name_template = backup-%s {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backup_use_same_host = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backup_use_temp_snapshot = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] chap_password = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] chap_username = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cinder_internal_tenant_project_id = 4d38862362954eda855b746c6d75a578 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cinder_internal_tenant_user_id = f553f9352db04007914ec105a547e329 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cloned_volume_same_az = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73455]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cluster = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] compression_format = gzip {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] compute_api_class = cinder.compute.nova.API {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] config_dir = [] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] config_source = [] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] control_exchange = openstack {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] debug = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] default_availability_zone = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] default_group_type = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] default_volume_type = lvmdriver-1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] disk_geometry = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] driver_client_cert = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] driver_client_cert_key = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] driver_data_namespace = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] driver_ssl_cert_path = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] driver_ssl_cert_verify = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] driver_use_ssl = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] enable_force_upload = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] enable_new_services = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] enable_unsupported_driver = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] enabled_backends = ['lvmdriver-1'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] enforce_multipath_for_image_xfer = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] filter_function = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance_api_insecure = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance_api_servers = ['http://192.168.122.32/image'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance_api_ssl_compression = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance_ca_certificates_file = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance_catalog_info = image:glance:publicURL {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance_certfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance_keyfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance_num_retries = 3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance_request_timeout = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] goodness_function = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] graceful_shutdown_timeout = 5 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] group_api_class = cinder.group.api.API {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] host = devstack {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] image_compress_on_upload = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] image_conversion_address_space_limit = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] image_conversion_cpu_limit = 60 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] image_conversion_disable = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] image_upload_use_cinder_backend = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] image_upload_use_internal_tenant = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] image_volume_cache_enabled = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] image_volume_cache_max_count = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] image_volume_cache_max_size_gb = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] init_host_max_objects_retrieval = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] instance_format = [instance: %(uuid)s] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] iscsi_target_flags = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] iscsi_write_cache = on {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] iser_helper = tgtadm {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] iser_ip_address = 192.168.122.32 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] iser_port = 3260 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] log_color = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] log_config_append = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] log_dir = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] log_file = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] log_options = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] log_rotate_interval = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] log_rotate_interval_type = days {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] log_rotation_type = none {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] max_age = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] max_logfile_count = 30 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] max_logfile_size_mb = 200 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] max_over_subscription_ratio = 20.0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] message_reap_interval = 86400 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] message_ttl = 2592000 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] migration_create_volume_timeout_secs = 300 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] monkey_patch = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] monkey_patch_modules = [] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] my_ip = 192.168.122.32 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] no_snapshot_gb_quota = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] num_iser_scan_tries = 3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] num_shell_tries = 3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] num_volume_device_scan_tries = 3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] nvmeof_conn_info_version = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] nvmet_ns_id = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] nvmet_port_id = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] osapi_max_limit = 1000 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] osapi_volume_ext_list = [] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] osapi_volume_listen = 0.0.0.0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] osapi_volume_listen_port = 8776 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73455]: INFO cinder.volume.manager [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 10 10:25:53 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] osapi_volume_use_ssl = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] osapi_volume_workers = 2 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] per_volume_size_limit = -1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] periodic_fuzzy_delay = 60 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] periodic_interval = 60 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] project_id_regex = [0-9a-f\-]+ {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] public_endpoint = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] publish_errors = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] quota_backup_gigabytes = 1000 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] quota_backups = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] quota_gigabytes = 1000 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] quota_groups = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] quota_snapshots = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] quota_volumes = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] rate_limit_burst = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] rate_limit_except_level = CRITICAL {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] rate_limit_interval = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] reinit_driver_count = 3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] replication_device = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] report_discard_supported = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] report_interval = 120 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] reservation_clean_interval = 86400 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] reservation_expire = 86400 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] reserved_image_namespaces = [] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] reserved_percentage = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] rpc_response_timeout = 120 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] run_external_periodic_tasks = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] scst_target_driver = iscsi {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] scst_target_iqn_name = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] service_down_time = 720 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] shell_completion = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] snapshot_name_template = snapshot-%s {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] snapshot_same_host = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] split_loggers = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] state_path = /opt/stack/data/cinder {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] storage_availability_zone = nova {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] storage_protocol = iSCSI {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:53 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] syslog_log_facility = LOG_USER {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] target_helper = lioadm {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] target_ip_address = 192.168.122.32 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] target_port = 3260 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] target_protocol = iscsi {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] target_secondary_ip_addresses = [] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] trace_flags = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] transfer_api_class = cinder.transfer.api.API {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] transport_url = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] until_refresh = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] use_chap_auth = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] use_default_quota_class = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] use_journal = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] use_json = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] use_multipath_for_image_xfer = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] use_stderr = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] use_syslog = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] verify_glance_signatures = enabled {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_api_class = cinder.volume.api.API {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_backend_name = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_clear = zero {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_clear_ionice = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_clear_size = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_copy_bps_limit = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_dd_blocksize = 1M {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_name_template = volume-%s {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_service_inithost_offload = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volume_usage_audit_period = month {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] zoning_mode = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:53 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_concurrency.disable_process_locking = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.admin_password = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.admin_token = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.admin_user = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.auth_admin_prefix = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.auth_port = 35357 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.auth_protocol = https {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.auth_section = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.auth_type = password {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.auth_uri = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.auth_version = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.cache = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.certfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.delay_auth_decision = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.http_connect_timeout = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.identity_uri = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.include_service_catalog = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.insecure = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.interface = public {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.keyfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_password = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:53 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcache_username = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.region_name = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.service_token_roles_required = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.service_type = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.token_cache_time = 300 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.32/identity {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.backend = dogpile.cache.null {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.backend_argument = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.backend_expiration_time = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.config_prefix = cache.oslo {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.debug_cache_backend = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.enable_retry_client = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.enable_socket_keepalive = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.enabled = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.enforce_fips_mode = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.expiration_time = 600 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.hashclient_retry_attempts = 2 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.memcache_dead_retry = 300 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.memcache_pool_maxsize = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.memcache_sasl_enabled = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.password = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack sudo[73459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 10 10:25:53 devstack sudo[73459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.proxies = [] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.redis_db = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.redis_sentinel_service_name = mymaster {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.redis_server = localhost:6379 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.retry_attempts = 2 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.retry_delay = 0.0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.socket_keepalive_count = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.socket_keepalive_idle = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.socket_keepalive_interval = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.socket_timeout = 1.0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.tls_allowed_ciphers = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.tls_cafile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.tls_certfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.tls_enabled = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.tls_keyfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cache.username = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] coordination.backend_url = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.asyncio_connection = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.asyncio_slave_connection = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.backend = sqlalchemy {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.connection = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.connection_debug = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.connection_parameters = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.connection_recycle_time = 3600 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.connection_trace = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.db_inc_retry_interval = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.db_max_retries = 20 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.db_max_retry_interval = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.db_retry_interval = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.max_overflow = 50 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.max_pool_size = 5 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.max_retries = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.mysql_wsrep_sync_wait = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.pool_timeout = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.retry_interval = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.slave_connection = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.sqlite_synchronous = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.synchronous_reader = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] database.use_db_reconnect = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler.connection_string = messaging:// {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler.enabled = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler.es_doc_type = notification {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler.es_scroll_size = 10000 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler.es_scroll_time = 2m {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler.filter_error_trace = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler.hmac_keys = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler.sentinel_service_name = mymaster {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler.socket_timeout = 0.1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler.trace_requests = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler.trace_sqlalchemy = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler_jaeger.process_tags = {} {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler_jaeger.service_name_prefix = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] profiler_otlp.service_name_prefix = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_policy.enforce_new_defaults = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: WARNING oslo_config.cfg [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_policy.enforce_scope = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_policy.policy_default_rule = default {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_policy.policy_file = policy.yaml {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_policy.remote_timeout = 60.0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] privsep_osbrick.group = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] privsep_osbrick.helper_command = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] privsep_osbrick.user = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cinder_sys_admin.group = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cinder_sys_admin.helper_command = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] cinder_sys_admin.user = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] service_user.auth_section = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] service_user.auth_type = password {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] service_user.cafile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] service_user.certfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] service_user.collect_timing = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] service_user.insecure = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] service_user.keyfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] service_user.send_service_user_token = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] service_user.split_loggers = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] service_user.timeout = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance.auth_section = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance.auth_type = password {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance.certfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance.collect_timing = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance.insecure = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance.keyfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance.region_name = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance.split_loggers = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] glance.timeout = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.backend_availability_zone = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.chap_password = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.chap_username = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.disk_geometry = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.driver_client_cert = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.driver_client_cert_key = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.driver_data_namespace = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.driver_use_ssl = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.enable_unsupported_driver = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.extra_capabilities = {} {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.filter_function = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.goodness_function = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.iscsi_target_flags = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.iscsi_write_cache = on {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.iser_helper = tgtadm {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.iser_ip_address = 192.168.122.32 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.iser_port = 3260 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.lvm_mirrors = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.lvm_share_target = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.lvm_type = auto {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.num_shell_tries = 3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.nvmet_port_id = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.replication_device = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.report_discard_supported = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.reserved_percentage = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.scst_target_driver = iscsi {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.scst_target_iqn_name = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.storage_protocol = iSCSI {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.target_helper = tgtadm {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.target_ip_address = 192.168.122.32 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.target_port = 3260 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.target_protocol = iscsi {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.trace_flags = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.unique_fqdn_network = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.use_chap_auth = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.volume_backend_name = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.volume_clear = zero {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.volume_clear_ionice = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.volume_clear_size = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.volume_group = cinder-volumes {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_reports.file_event_handler = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_reports.log_dir = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.backend_availability_zone = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.backend_host = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.chap_password = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.chap_username = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.chiscsi_conf = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.disk_geometry = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.driver_client_cert = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.driver_data_namespace = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.driver_use_ssl = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.extra_capabilities = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.filter_function = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.goodness_function = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.iser_helper = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.iser_ip_address = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.iser_port = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.iser_target_prefix = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.lvm_conf_file = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.lvm_mirrors = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.lvm_share_target = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.lvm_type = auto {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.num_shell_tries = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.nvmet_port_id = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.replication_device = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.report_discard_supported = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.reserved_percentage = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.scst_target_driver = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.storage_protocol = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.target_helper = lioadm {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.target_ip_address = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.target_port = 3260 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.target_protocol = iscsi {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.trace_flags = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.use_chap_auth = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.volume_clear = zero {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.volume_clear_size = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] lvmdriver-1.volumes_dir = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.ssl = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.ssl_version = {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_notifications.driver = [] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_notifications.retry = -1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] oslo_messaging_notifications.transport_url = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] key_manager.fixed_key = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.barbican_api_version = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.barbican_endpoint = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.barbican_endpoint_type = public {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.barbican_region_name = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.cafile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.certfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.collect_timing = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.insecure = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.keyfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.number_of_retries = 60 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.retry_delay = 1 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.send_service_user_token = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.split_loggers = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.timeout = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.verify_ssl = True {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican.verify_ssl_path = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican_service_user.auth_section = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican_service_user.auth_type = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican_service_user.cafile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican_service_user.certfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican_service_user.collect_timing = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican_service_user.insecure = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican_service_user.keyfile = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican_service_user.split_loggers = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] barbican_service_user.timeout = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vault.approle_role_id = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vault.approle_secret_id = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vault.kv_mountpoint = secret {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vault.kv_path = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vault.kv_version = 2 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vault.namespace = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vault.root_token_id = **** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vault.ssl_ca_crt_file = None {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vault.timeout = 60.0 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vault.use_ssl = False {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:25:53 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] ******************************************************************************** {{(pid=73355) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 10:25:54 devstack sudo[73459]: pam_unix(sudo:session): session closed for user root Apr 10 10:25:54 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:54 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:54 devstack sudo[73468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:25:54 devstack sudo[73468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:25:54 devstack sudo[73468]: pam_unix(sudo:session): session closed for user root Apr 10 10:25:54 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.540s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:54 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:25:54 devstack cinder-volume[73455]: INFO cinder.brick.local_dev.lvm [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 10 10:25:54 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:54 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:54 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:54 devstack sudo[73719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:25:54 devstack sudo[73719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:25:55 devstack sudo[73719]: pam_unix(sudo:session): session closed for user root Apr 10 10:25:55 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:55 devstack cinder-volume[73455]: DEBUG cinder.brick.local_dev.lvm [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73455) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 10 10:25:55 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:55 devstack sudo[73948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:25:55 devstack sudo[73948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:25:56 devstack sudo[73948]: pam_unix(sudo:session): session closed for user root Apr 10 10:25:56 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.061s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:56 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:56 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:56 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:56 devstack sudo[74112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:25:56 devstack sudo[74112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:25:56 devstack sudo[74112]: pam_unix(sudo:session): session closed for user root Apr 10 10:25:56 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.587s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:56 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:56 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:56 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:57 devstack sudo[74149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 10 10:25:57 devstack sudo[74149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:25:57 devstack sudo[74149]: pam_unix(sudo:session): session closed for user root Apr 10 10:25:57 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.469s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:57 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:57 devstack sudo[74152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:25:57 devstack sudo[74152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:25:58 devstack sudo[74152]: pam_unix(sudo:session): session closed for user root Apr 10 10:25:58 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.544s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:58 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:58 devstack sudo[74157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:25:58 devstack sudo[74157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:25:58 devstack sudo[74157]: pam_unix(sudo:session): session closed for user root Apr 10 10:25:58 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.533s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:58 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:58 devstack sudo[74164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:25:58 devstack sudo[74164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:25:59 devstack sudo[74164]: pam_unix(sudo:session): session closed for user root Apr 10 10:25:59 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.519s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:59 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:59 devstack sudo[74168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:25:59 devstack sudo[74168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:25:59 devstack sudo[74168]: pam_unix(sudo:session): session closed for user root Apr 10 10:25:59 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:59 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:59 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:25:59 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:25:59 devstack sudo[74172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:25:59 devstack sudo[74172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:00 devstack sudo[74172]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:00 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:00 devstack cinder-volume[73455]: INFO cinder.volume.drivers.lvm [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 10 10:26:00 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:00 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:00 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:00 devstack sudo[74291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:26:00 devstack sudo[74291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:00 devstack sudo[74291]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:00 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.484s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:00 devstack cinder-volume[73455]: DEBUG cinder.volume.drivers.lvm [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Updating volume stats {{(pid=73455) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:26:00 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:00 devstack sudo[74297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:26:00 devstack sudo[74297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:01 devstack sudo[74297]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:01 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.519s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:01 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:01 devstack sudo[74436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:26:01 devstack sudo[74436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:01 devstack sudo[74436]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:01 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:01 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:01 devstack sudo[74439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:26:01 devstack sudo[74439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:02 devstack sudo[74439]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:02 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.544s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:02 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:02 devstack sudo[74445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:26:02 devstack sudo[74445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:02 devstack sudo[74445]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:02 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:02 devstack cinder-volume[73455]: INFO cinder.volume.driver [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Driver hasn't implemented _init_vendor_properties() Apr 10 10:26:02 devstack cinder-volume[73455]: DEBUG cinder.volume.driver [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73455) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 10:26:02 devstack cinder-volume[73455]: DEBUG oslo_db.sqlalchemy.engines [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73455) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:26:02 devstack cinder-volume[73455]: DEBUG dbcounter [-] [73455] Writer thread running {{(pid=73455) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:26:02 devstack cinder-volume[73455]: DEBUG cinder.db.sqlalchemy.api [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Building query based on filter {{(pid=73455) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 10:26:02 devstack cinder-volume[73455]: DEBUG cinder.image.image_utils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73455) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 10:26:02 devstack cinder-volume[73455]: INFO cinder.keymgr.migration [None req-d911e4d6-798e-47d7-9859-c16c674287cc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 10:26:02 devstack cinder-volume[73455]: DEBUG cinder.volume.drivers.lvm [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Updating volume stats {{(pid=73455) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:26:02 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:02 devstack sudo[74452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:26:02 devstack sudo[74452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:03 devstack cinder-volume[73355]: DEBUG dbcounter [-] [73355] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73355) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:26:03 devstack sudo[74452]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:03 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.517s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:03 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:03 devstack sudo[74457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:26:03 devstack sudo[74457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:03 devstack sudo[74457]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:03 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.514s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:03 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:03 devstack sudo[74461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:26:03 devstack sudo[74461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:04 devstack sudo[74461]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:04 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.566s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:04 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:04 devstack sudo[74465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:26:04 devstack sudo[74465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:04 devstack sudo[74465]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:04 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.538s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:04 devstack cinder-volume[73455]: DEBUG cinder.manager [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Notifying Schedulers of capabilities ... {{(pid=73455) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:26:05 devstack cinder-volume[73455]: INFO cinder.volume.manager [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Driver initialization completed successfully. Apr 10 10:26:05 devstack cinder-volume[73455]: INFO cinder.manager [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Initiating service 2 cleanup Apr 10 10:26:05 devstack cinder-volume[73455]: INFO cinder.manager [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Service 2 cleanup completed. Apr 10 10:26:05 devstack cinder-volume[73455]: DEBUG cinder.service [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Creating RPC server for service cinder-volume {{(pid=73455) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 10:26:05 devstack cinder-volume[73455]: DEBUG cinder.service [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73455) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 10:26:05 devstack cinder-volume[73455]: INFO cinder.volume.manager [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 10 10:26:05 devstack cinder-volume[73455]: DEBUG cinder.volume.drivers.lvm [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Updating volume stats {{(pid=73455) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:26:05 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:05 devstack sudo[74472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:26:05 devstack sudo[74472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:05 devstack sudo[74472]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:05 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.538s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:05 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:05 devstack sudo[74475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:26:05 devstack sudo[74475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:06 devstack sudo[74475]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:06 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:06 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:06 devstack sudo[74532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:26:06 devstack sudo[74532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:06 devstack sudo[74532]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:06 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.529s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:06 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:26:06 devstack sudo[74535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:26:06 devstack sudo[74535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:26:07 devstack sudo[74535]: pam_unix(sudo:session): session closed for user root Apr 10 10:26:07 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.508s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:26:07 devstack cinder-volume[73455]: INFO cinder.volume.manager [None req-de34f1e6-17ca-4fb8-8da7-56a2c9d551ba None None] Driver post RPC initialization completed successfully. Apr 10 10:26:17 devstack cinder-volume[73455]: DEBUG dbcounter [-] [73455] Writing DB stats cinder:SELECT=4 {{(pid=73455) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:26:17 devstack cinder-volume[73455]: DEBUG dbcounter [-] [73455] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73455) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:27:34 devstack cinder-volume[73455]: DEBUG oslo_service.periodic_task [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73455) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:27:34 devstack cinder-volume[73455]: DEBUG cinder.volume.drivers.lvm [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Updating volume stats {{(pid=73455) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:27:34 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:34 devstack sudo[79462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:34 devstack sudo[79462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:34 devstack sudo[79462]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:34 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:34 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:34 devstack sudo[79470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:34 devstack sudo[79470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:35 devstack sudo[79470]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:35 devstack sudo[79476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:35 devstack sudo[79476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:35 devstack sudo[79476]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.496s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:35 devstack sudo[79479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:35 devstack sudo[79479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:36 devstack sudo[79479]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:36 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.516s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:36 devstack cinder-volume[73455]: DEBUG cinder.manager [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Notifying Schedulers of capabilities ... {{(pid=73455) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:28:17 devstack cinder-volume[73455]: DEBUG dbcounter [-] [73455] Writing DB stats cinder:SELECT=1 {{(pid=73455) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:28:17 devstack cinder-volume[73455]: DEBUG dbcounter [-] [73455] Writing DB stats cinder:UPDATE=1 {{(pid=73455) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:28:34 devstack cinder-volume[73455]: DEBUG oslo_service.periodic_task [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73455) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:28:34 devstack cinder-volume[73455]: DEBUG cinder.volume.drivers.lvm [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Updating volume stats {{(pid=73455) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:28:34 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:28:34 devstack sudo[81321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:28:34 devstack sudo[81321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:28:34 devstack sudo[81321]: pam_unix(sudo:session): session closed for user root Apr 10 10:28:34 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:28:34 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:28:34 devstack sudo[81327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:28:34 devstack sudo[81327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:28:35 devstack sudo[81327]: pam_unix(sudo:session): session closed for user root Apr 10 10:28:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:28:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:28:35 devstack sudo[81330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:28:35 devstack sudo[81330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:28:35 devstack sudo[81330]: pam_unix(sudo:session): session closed for user root Apr 10 10:28:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:28:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:28:35 devstack sudo[81334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:28:35 devstack sudo[81334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:28:36 devstack sudo[81334]: pam_unix(sudo:session): session closed for user root Apr 10 10:28:36 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:28:36 devstack cinder-volume[73455]: DEBUG cinder.manager [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Notifying Schedulers of capabilities ... {{(pid=73455) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:29:34 devstack cinder-volume[73455]: DEBUG oslo_service.periodic_task [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73455) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:29:34 devstack cinder-volume[73455]: DEBUG cinder.volume.drivers.lvm [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Updating volume stats {{(pid=73455) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:29:34 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:34 devstack sudo[82511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:29:34 devstack sudo[82511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:34 devstack cinder-volume[73355]: INFO oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Caught SIGTERM, stopping children Apr 10 10:29:34 devstack cinder-volume[73355]: DEBUG oslo_concurrency.lockutils [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Acquiring lock "singleton_lock" {{(pid=73355) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:29:34 devstack cinder-volume[73355]: DEBUG oslo_concurrency.lockutils [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Acquired lock "singleton_lock" {{(pid=73355) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:29:34 devstack cinder-volume[73355]: DEBUG oslo_concurrency.lockutils [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Releasing lock "singleton_lock" {{(pid=73355) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:29:34 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Stop services. {{(pid=73355) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 10:29:34 devstack cinder-volume[73355]: DEBUG oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Killing children. {{(pid=73355) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 10:29:34 devstack cinder-volume[73355]: INFO oslo_service.backend._eventlet.service [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Waiting on 1 children to exit Apr 10 10:29:34 devstack sudo[82511]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:34 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:34 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:34 devstack sudo[82517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:29:34 devstack sudo[82517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:35 devstack sudo[82517]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:35 devstack sudo[82521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:29:35 devstack sudo[82521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:35 devstack sudo[82521]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.445s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:35 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:35 devstack sudo[82524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:29:35 devstack sudo[82524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:36 devstack sudo[82524]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:36 devstack cinder-volume[73455]: DEBUG oslo_concurrency.processutils [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73455) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:36 devstack cinder-volume[73455]: DEBUG cinder.manager [None req-bde7c9a4-2392-48f9-864a-4f4e9219d614 None None] Notifying Schedulers of capabilities ... {{(pid=73455) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:29:39 devstack cinder-volume[73455]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 10 10:29:39 devstack cinder-volume[82527]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 10:29:39 devstack cinder-volume[82527]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:29:39 devstack cinder-volume[82527]: we strongly recommend against using it for new projects. Apr 10 10:29:39 devstack cinder-volume[82527]: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:29:39 devstack cinder-volume[82527]: framework. For more detail see Apr 10 10:29:39 devstack cinder-volume[82527]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:29:39 devstack cinder-volume[82527]: import eventlet # noqa Apr 10 10:29:40 devstack cinder-volume[73455]: DEBUG oslo_concurrency.lockutils [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Acquiring lock "singleton_lock" {{(pid=73455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:29:40 devstack cinder-volume[73455]: DEBUG oslo_concurrency.lockutils [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Acquired lock "singleton_lock" {{(pid=73455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:29:40 devstack cinder-volume[73455]: DEBUG oslo_concurrency.lockutils [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Releasing lock "singleton_lock" {{(pid=73455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:29:40 devstack cinder-volume[73455]: WARNING amqp [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:29:40 devstack cinder-volume[73455]: WARNING amqp [None req-0ab7a821-424b-414e-97d7-55ef82f877af None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:29:41 devstack cinder-volume[82527]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82527) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:29:41 devstack cinder-volume[82527]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82527) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:29:41 devstack cinder-volume[82527]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82527) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:29:42 devstack cinder-volume[82527]: INFO dbcounter [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Registered counter for database cinder Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_db.sqlalchemy.engines [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG dbcounter [-] [82527] Writer thread running {{(pid=82527) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:29:42 devstack cinder-volume[82527]: INFO cinder.rpc [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 10:29:42 devstack cinder-volume[82527]: INFO cinder.rpc [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_db.sqlalchemy.engines [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:29:42 devstack cinder-volume[82527]: INFO cinder.volume.manager [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Determined volume DB was empty at startup. Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG cinder.volume.manager [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82527) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 10:29:42 devstack cinder-volume[82527]: INFO cinder.volume.manager [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 10:29:42 devstack cinder-volume[82527]: WARNING stevedore.named [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:29:42 devstack cinder-volume[82527]: WARNING castellan.key_manager [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:29:42 devstack cinder-volume[82527]: WARNING cinder.keymgr.conf_key_mgr [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:29:42 devstack cinder-volume[82527]: INFO cinder.volume.manager [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_db.sqlalchemy.engines [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:29:42 devstack cinder-volume[82527]: INFO oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Starting 1 workers Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Started child 82645 {{(pid=82527) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Full set of CONF: {{(pid=82527) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] ******************************************************************************** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Configuration options gathered from: {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] ================================================================================ {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] allow_availability_zone_fallback = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] allow_compression_on_image_upload = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] allowed_direct_url_schemes = [] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] api_rate_limit = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] auth_strategy = keystone {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_availability_zone = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_host = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_name = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_stats_polling_interval = 60 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backup_api_class = cinder.backup.api.API {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backup_name_template = backup-%s {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backup_use_same_host = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backup_use_temp_snapshot = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] chap_password = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] chap_username = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cinder_internal_tenant_project_id = 4d38862362954eda855b746c6d75a578 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cinder_internal_tenant_user_id = f553f9352db04007914ec105a547e329 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cluster = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] compression_format = gzip {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] compute_api_class = cinder.compute.nova.API {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] config_dir = [] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] config_source = [] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] control_exchange = openstack {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] debug = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] default_availability_zone = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] default_group_type = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82645]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] default_volume_type = QuobyteHD {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] disk_geometry = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] driver_client_cert = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] driver_client_cert_key = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] driver_data_namespace = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] driver_ssl_cert_path = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] driver_ssl_cert_verify = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] driver_use_ssl = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] enable_new_services = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] enable_unsupported_driver = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] enabled_backends = ['QuobyteHD'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] enforce_multipath_for_image_xfer = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] filter_function = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance_api_insecure = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance_api_servers = ['http://192.168.122.32/image'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance_api_ssl_compression = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance_ca_certificates_file = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance_catalog_info = image:glance:publicURL {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance_certfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance_keyfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance_num_retries = 3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance_request_timeout = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] goodness_function = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] graceful_shutdown_timeout = 5 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] group_api_class = cinder.group.api.API {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] host = devstack {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] image_compress_on_upload = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] image_conversion_address_space_limit = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] image_conversion_cpu_limit = 60 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] image_conversion_disable = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] image_upload_use_cinder_backend = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] image_upload_use_internal_tenant = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] image_volume_cache_enabled = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] image_volume_cache_max_count = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] image_volume_cache_max_size_gb = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] init_host_max_objects_retrieval = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] instance_format = [instance: %(uuid)s] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] iscsi_target_flags = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] iscsi_write_cache = on {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] iser_helper = tgtadm {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] iser_ip_address = 192.168.122.32 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] iser_port = 3260 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] log_color = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] log_config_append = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] log_dir = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] log_file = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] log_options = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] log_rotate_interval = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] log_rotate_interval_type = days {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] log_rotation_type = none {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] max_age = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] max_logfile_count = 30 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] max_logfile_size_mb = 200 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] max_over_subscription_ratio = 20.0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] message_reap_interval = 86400 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] message_ttl = 2592000 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] migration_create_volume_timeout_secs = 300 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] monkey_patch = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] monkey_patch_modules = [] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] my_ip = 192.168.122.32 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] no_snapshot_gb_quota = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] num_iser_scan_tries = 3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] num_shell_tries = 3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] num_volume_device_scan_tries = 3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] nvmeof_conn_info_version = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] nvmet_ns_id = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] nvmet_port_id = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] osapi_max_limit = 1000 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] osapi_volume_ext_list = [] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] osapi_volume_listen_port = 8776 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] osapi_volume_use_ssl = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] osapi_volume_workers = 2 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] per_volume_size_limit = -1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] periodic_fuzzy_delay = 60 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] periodic_interval = 60 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] public_endpoint = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] publish_errors = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] quota_backup_gigabytes = 1000 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] quota_backups = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] quota_gigabytes = 1000 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] quota_groups = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] quota_snapshots = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] quota_volumes = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] rate_limit_burst = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] rate_limit_except_level = CRITICAL {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] rate_limit_interval = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] reinit_driver_count = 3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] replication_device = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] report_discard_supported = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] report_interval = 120 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] reservation_clean_interval = 86400 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] reservation_expire = 86400 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] reserved_image_namespaces = [] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] reserved_percentage = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] rpc_response_timeout = 120 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] run_external_periodic_tasks = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] scst_target_driver = iscsi {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] scst_target_iqn_name = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] service_down_time = 720 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] shell_completion = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] snapshot_name_template = snapshot-%s {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] split_loggers = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] state_path = /opt/stack/data/cinder {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] storage_availability_zone = nova {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] storage_protocol = iSCSI {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] syslog_log_facility = LOG_USER {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] target_helper = lioadm {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] target_ip_address = 192.168.122.32 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] target_port = 3260 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] target_protocol = iscsi {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] target_secondary_ip_addresses = [] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] trace_flags = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] transport_url = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] until_refresh = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] use_chap_auth = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] use_default_quota_class = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] use_journal = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] use_json = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] use_multipath_for_image_xfer = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] use_stderr = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] use_syslog = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] verify_glance_signatures = enabled {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_api_class = cinder.volume.api.API {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_backend_name = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_clear = zero {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_clear_ionice = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_clear_size = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_copy_bps_limit = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_dd_blocksize = 1M {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_name_template = volume-%s {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_service_inithost_offload = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volume_usage_audit_period = month {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] zoning_mode = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_concurrency.disable_process_locking = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.admin_password = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.admin_token = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.admin_user = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.auth_port = 35357 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.auth_protocol = https {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.auth_section = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.auth_type = password {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.auth_uri = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.auth_version = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.cache = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.certfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.identity_uri = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.include_service_catalog = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.insecure = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.interface = public {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.keyfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_password = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcache_username = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.region_name = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.service_type = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.32/identity {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.backend = dogpile.cache.null {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.backend_argument = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.backend_expiration_time = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.config_prefix = cache.oslo {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.debug_cache_backend = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.enable_retry_client = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.enable_socket_keepalive = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.enabled = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.enforce_fips_mode = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.expiration_time = 600 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.hashclient_retry_attempts = 2 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.memcache_dead_retry = 300 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.memcache_pool_maxsize = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.memcache_sasl_enabled = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.password = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.proxies = [] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.redis_db = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.redis_server = localhost:6379 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.retry_attempts = 2 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.retry_delay = 0.0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.socket_keepalive_count = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.socket_keepalive_idle = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.socket_keepalive_interval = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.socket_timeout = 1.0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.tls_allowed_ciphers = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.tls_cafile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.tls_certfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.tls_enabled = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.tls_keyfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cache.username = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] coordination.backend_url = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.asyncio_connection = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.asyncio_slave_connection = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.backend = sqlalchemy {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.connection = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.connection_debug = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.connection_parameters = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.connection_recycle_time = 3600 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.connection_trace = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.db_inc_retry_interval = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.db_max_retries = 20 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.db_max_retry_interval = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.db_retry_interval = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.max_overflow = 50 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.max_pool_size = 5 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.max_retries = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.mysql_wsrep_sync_wait = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.pool_timeout = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.retry_interval = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.slave_connection = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.sqlite_synchronous = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.synchronous_reader = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] database.use_db_reconnect = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler.connection_string = messaging:// {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler.enabled = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler.es_doc_type = notification {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler.es_scroll_size = 10000 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler.es_scroll_time = 2m {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler.filter_error_trace = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler.hmac_keys = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler.sentinel_service_name = mymaster {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler.socket_timeout = 0.1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler.trace_requests = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler.trace_sqlalchemy = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler_jaeger.process_tags = {} {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler_jaeger.service_name_prefix = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] profiler_otlp.service_name_prefix = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_policy.enforce_new_defaults = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: WARNING oslo_config.cfg [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_policy.enforce_scope = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_policy.policy_default_rule = default {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_policy.policy_file = policy.yaml {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] privsep_osbrick.group = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] privsep_osbrick.helper_command = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] privsep_osbrick.user = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cinder_sys_admin.group = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cinder_sys_admin.helper_command = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] cinder_sys_admin.user = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] service_user.auth_section = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] service_user.auth_type = password {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] service_user.cafile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] service_user.certfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] service_user.collect_timing = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] service_user.insecure = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] service_user.keyfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] service_user.send_service_user_token = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] service_user.split_loggers = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] service_user.timeout = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance.auth_section = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance.auth_type = password {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance.certfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance.collect_timing = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance.insecure = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance.keyfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance.region_name = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance.split_loggers = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] glance.timeout = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.backend_availability_zone = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.chap_password = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.chap_username = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.disk_geometry = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.driver_client_cert = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.driver_client_cert_key = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.driver_data_namespace = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.driver_use_ssl = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.extra_capabilities = {} {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.filter_function = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.goodness_function = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.iscsi_target_flags = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.iscsi_write_cache = on {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.iser_helper = tgtadm {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.iser_ip_address = 192.168.122.32 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.iser_port = 3260 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nas_host = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nas_login = admin {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nas_mount_options = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nas_password = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nas_private_key = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nas_share_path = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.num_shell_tries = 3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.quobyte_volume_url = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.replication_device = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.report_discard_supported = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.reserved_percentage = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.target_helper = tgtadm {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82645]: INFO cinder.volume.manager [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.target_ip_address = 192.168.122.32 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.target_port = 3260 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.target_protocol = iscsi {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.trace_flags = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.unique_fqdn_network = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.use_chap_auth = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.volume_backend_name = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.volume_clear = zero {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.volume_clear_ionice = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.volume_clear_size = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_reports.file_event_handler = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_reports.log_dir = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.backend_availability_zone = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.backend_host = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.chap_password = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.chap_username = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.chiscsi_conf = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.disk_geometry = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.driver_client_cert = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.driver_data_namespace = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.driver_use_ssl = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.extra_capabilities = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.filter_function = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.goodness_function = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.iser_helper = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.iser_ip_address = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.iser_port = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82645]: DEBUG cinder.volume.drivers.remotefs [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82645) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.iser_target_prefix = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nas_host = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nas_login = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nas_mount_options = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nas_password = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nas_private_key = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nas_share_path = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nas_ssh_port = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.num_shell_tries = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.nvmet_port_id = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.replication_device = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.report_discard_supported = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.reserved_percentage = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.scst_target_driver = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.storage_protocol = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.target_helper = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.target_ip_address = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.target_port = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.target_prefix = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.target_protocol = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.trace_flags = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.use_chap_auth = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.volume_clear = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.volume_clear_size = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] QuobyteHD.volumes_dir = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.ssl = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_notifications.driver = [] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_notifications.retry = -1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] key_manager.fixed_key = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.barbican_api_version = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.barbican_endpoint = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.barbican_endpoint_type = public {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.barbican_region_name = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.cafile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.certfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.collect_timing = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.insecure = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.keyfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.number_of_retries = 60 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.retry_delay = 1 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.send_service_user_token = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.split_loggers = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.timeout = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.verify_ssl = True {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican.verify_ssl_path = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican_service_user.auth_section = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican_service_user.auth_type = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican_service_user.cafile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican_service_user.certfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican_service_user.collect_timing = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican_service_user.insecure = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican_service_user.keyfile = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican_service_user.split_loggers = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] barbican_service_user.timeout = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vault.approle_role_id = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vault.approle_secret_id = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vault.kv_mountpoint = secret {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vault.kv_path = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vault.kv_version = 2 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vault.namespace = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vault.root_token_id = **** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vault.ssl_ca_crt_file = None {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vault.timeout = 60.0 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vault.use_ssl = False {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:42 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] ******************************************************************************** {{(pid=82527) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 10:29:42 devstack cinder-volume[82645]: DEBUG cinder.volume.drivers.quobyte [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82645) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 10:29:42 devstack cinder-volume[82645]: WARNING cinder.volume.drivers.quobyte [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 10:29:42 devstack cinder-volume[82645]: WARNING cinder.volume.drivers.quobyte [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 10:29:42 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Running cmd (subprocess): mount.quobyte {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:42 devstack quobyte-client[82646]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 10:29:42 devstack quobyte-client[82646]: Invalid parameters found, error: missing mount point. Apr 10 10:29:42 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:42 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:29:42 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:29:42 devstack cinder-volume[82645]: DEBUG cinder.volume.drivers.quobyte [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=82645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:29:42 devstack cinder-volume[82645]: INFO cinder.volume.drivers.quobyte [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac ... Apr 10 10:29:42 devstack quobyte-client[82646]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 10:29:42 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 -c /etc/quobyte/client-cinder.cfg {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:42 devstack quobyte-client[82646]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 10:29:42 devstack sudo[82649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 -c /etc/quobyte/client-cinder.cfg Apr 10 10:29:42 devstack sudo[82649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:43 devstack sudo[82649]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.517s {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:43 devstack cinder-volume[82645]: INFO cinder.volume.drivers.quobyte [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac succeeded Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG cinder.volume.drivers.quobyte [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=82645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.525s {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:43 devstack sudo[82718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:29:43 devstack sudo[82718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:43 devstack sudo[82718]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.424s {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:43 devstack cinder-volume[82645]: INFO cinder.volume.driver [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG cinder.volume.driver [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82645) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG oslo_db.sqlalchemy.engines [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82645) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG dbcounter [-] [82645] Writer thread running {{(pid=82645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG cinder.db.sqlalchemy.api [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Building query based on filter {{(pid=82645) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG cinder.image.image_utils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82645) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 10:29:43 devstack cinder-volume[82645]: INFO cinder.keymgr.migration [None req-016eb612-cbe5-461d-bc72-f70c9b944afc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG cinder.volume.drivers.quobyte [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=82645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG cinder.volume.drivers.quobyte [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=82645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:29:43 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:43 devstack sudo[82721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:29:43 devstack sudo[82721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:44 devstack sudo[82721]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:44 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.446s {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:44 devstack cinder-volume[82645]: DEBUG cinder.manager [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Notifying Schedulers of capabilities ... {{(pid=82645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:29:44 devstack cinder-volume[82645]: INFO cinder.volume.manager [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Driver initialization completed successfully. Apr 10 10:29:44 devstack cinder-volume[82645]: INFO cinder.manager [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Initiating service 3 cleanup Apr 10 10:29:44 devstack cinder-volume[82645]: INFO cinder.manager [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Service 3 cleanup completed. Apr 10 10:29:44 devstack cinder-volume[82645]: DEBUG cinder.service [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Creating RPC server for service cinder-volume {{(pid=82645) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 10:29:44 devstack cinder-volume[82645]: DEBUG cinder.service [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82645) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 10:29:44 devstack cinder-volume[82645]: INFO cinder.volume.manager [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 10:29:44 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:29:44 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:29:44 devstack cinder-volume[82645]: DEBUG cinder.volume.drivers.quobyte [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=82645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:29:44 devstack cinder-volume[82645]: DEBUG cinder.volume.drivers.quobyte [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=82645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:29:44 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:29:44 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:44 devstack sudo[82726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:29:44 devstack sudo[82726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:45 devstack sudo[82726]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:45 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.637s {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:45 devstack cinder-volume[82645]: INFO cinder.volume.manager [None req-8188e2a1-cb05-4073-b446-74467bc499d2 None None] Driver post RPC initialization completed successfully. Apr 10 10:29:48 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-40f437be-9d9c-4463-93bd-c3ce86ef701c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:29:48 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-40f437be-9d9c-4463-93bd-c3ce86ef701c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:29:48 devstack cinder-volume[82645]: DEBUG cinder.volume.drivers.quobyte [None req-40f437be-9d9c-4463-93bd-c3ce86ef701c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=82645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:29:48 devstack cinder-volume[82645]: DEBUG cinder.volume.drivers.quobyte [None req-40f437be-9d9c-4463-93bd-c3ce86ef701c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=82645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:29:48 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-40f437be-9d9c-4463-93bd-c3ce86ef701c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:29:48 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-40f437be-9d9c-4463-93bd-c3ce86ef701c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:48 devstack sudo[82792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:29:48 devstack sudo[82792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:48 devstack sudo[82792]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:48 devstack cinder-volume[82645]: DEBUG oslo_concurrency.processutils [None req-40f437be-9d9c-4463-93bd-c3ce86ef701c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.425s {{(pid=82645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:48 devstack cinder-volume[82645]: DEBUG cinder.manager [None req-40f437be-9d9c-4463-93bd-c3ce86ef701c None None] Notifying Schedulers of capabilities ... {{(pid=82645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:29:51 devstack cinder-volume[82527]: INFO oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Caught SIGTERM, stopping children Apr 10 10:29:51 devstack cinder-volume[82527]: DEBUG oslo_concurrency.lockutils [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Acquiring lock "singleton_lock" {{(pid=82527) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:29:51 devstack cinder-volume[82527]: DEBUG oslo_concurrency.lockutils [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Acquired lock "singleton_lock" {{(pid=82527) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:29:51 devstack cinder-volume[82527]: DEBUG oslo_concurrency.lockutils [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Releasing lock "singleton_lock" {{(pid=82527) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:29:51 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Stop services. {{(pid=82527) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 10:29:51 devstack cinder-volume[82527]: DEBUG oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Killing children. {{(pid=82527) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 10:29:51 devstack cinder-volume[82527]: INFO oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Waiting on 1 children to exit Apr 10 10:29:52 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Acquiring lock "singleton_lock" {{(pid=82645) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:29:52 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Acquired lock "singleton_lock" {{(pid=82645) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:29:52 devstack cinder-volume[82645]: DEBUG oslo_concurrency.lockutils [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Releasing lock "singleton_lock" {{(pid=82645) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:29:52 devstack cinder-volume[82645]: WARNING amqp [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:29:52 devstack cinder-volume[82645]: WARNING amqp [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:29:52 devstack cinder-volume[82527]: INFO oslo_service.backend._eventlet.service [None req-78a7f505-4756-467a-bdf8-d68117007ab0 None None] Child 82645 exited with status 0 Apr 10 10:29:52 devstack cinder-volume[82863]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 10:29:52 devstack cinder-volume[82863]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:29:52 devstack cinder-volume[82863]: we strongly recommend against using it for new projects. Apr 10 10:29:52 devstack cinder-volume[82863]: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:29:52 devstack cinder-volume[82863]: framework. For more detail see Apr 10 10:29:52 devstack cinder-volume[82863]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:29:52 devstack cinder-volume[82863]: import eventlet # noqa Apr 10 10:29:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:29:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:29:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82863) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:29:55 devstack cinder-volume[82863]: INFO dbcounter [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Registered counter for database cinder Apr 10 10:29:55 devstack cinder-volume[82863]: DEBUG oslo_db.sqlalchemy.engines [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writer thread running {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:29:56 devstack cinder-volume[82863]: INFO cinder.rpc [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 10:29:56 devstack cinder-volume[82863]: INFO cinder.rpc [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_db.sqlalchemy.engines [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:29:56 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Determined volume DB was empty at startup. Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82863) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 10:29:56 devstack cinder-volume[82863]: WARNING stevedore.named [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:29:56 devstack cinder-volume[82863]: WARNING castellan.key_manager [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:29:56 devstack cinder-volume[82863]: WARNING cinder.keymgr.conf_key_mgr [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:29:56 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_db.sqlalchemy.engines [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:29:56 devstack cinder-volume[82863]: INFO oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Starting 1 workers Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Started child 83037 {{(pid=82863) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Full set of CONF: {{(pid=82863) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] ******************************************************************************** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Configuration options gathered from: {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] ================================================================================ {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] allow_availability_zone_fallback = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] allow_compression_on_image_upload = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] allowed_direct_url_schemes = [] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] api_rate_limit = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] auth_strategy = keystone {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_availability_zone = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_host = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_name = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_stats_polling_interval = 60 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backup_api_class = cinder.backup.api.API {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backup_name_template = backup-%s {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backup_use_same_host = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backup_use_temp_snapshot = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] chap_password = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] chap_username = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cinder_internal_tenant_project_id = 4d38862362954eda855b746c6d75a578 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cinder_internal_tenant_user_id = f553f9352db04007914ec105a547e329 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cluster = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] compression_format = gzip {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] compute_api_class = cinder.compute.nova.API {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] config_dir = [] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] config_source = [] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] control_exchange = openstack {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] debug = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] default_availability_zone = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] default_group_type = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] default_volume_type = QuobyteHD {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] disk_geometry = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] driver_client_cert = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] driver_client_cert_key = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] driver_data_namespace = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] driver_ssl_cert_path = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] driver_ssl_cert_verify = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] driver_use_ssl = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] enable_new_services = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[83037]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] enable_unsupported_driver = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] enabled_backends = ['QuobyteHD'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] enforce_multipath_for_image_xfer = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] filter_function = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance_api_insecure = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance_api_servers = ['http://192.168.122.32/image'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance_api_ssl_compression = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance_ca_certificates_file = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance_catalog_info = image:glance:publicURL {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance_certfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance_keyfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance_num_retries = 3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance_request_timeout = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] goodness_function = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] graceful_shutdown_timeout = 5 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] group_api_class = cinder.group.api.API {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] host = devstack {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] image_compress_on_upload = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] image_conversion_address_space_limit = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] image_conversion_cpu_limit = 60 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] image_conversion_disable = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] image_upload_use_cinder_backend = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] image_upload_use_internal_tenant = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] image_volume_cache_enabled = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] image_volume_cache_max_count = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] image_volume_cache_max_size_gb = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] init_host_max_objects_retrieval = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] instance_format = [instance: %(uuid)s] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] iscsi_target_flags = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] iscsi_write_cache = on {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] iser_helper = tgtadm {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] iser_ip_address = 192.168.122.32 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] iser_port = 3260 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] log_color = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] log_config_append = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] log_dir = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] log_file = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] log_options = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] log_rotate_interval = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] log_rotate_interval_type = days {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] log_rotation_type = none {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] max_age = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] max_logfile_count = 30 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] max_logfile_size_mb = 200 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] max_over_subscription_ratio = 20.0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] message_reap_interval = 86400 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] message_ttl = 2592000 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] migration_create_volume_timeout_secs = 300 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] monkey_patch = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] monkey_patch_modules = [] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] my_ip = 192.168.122.32 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] no_snapshot_gb_quota = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] num_iser_scan_tries = 3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] num_shell_tries = 3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] num_volume_device_scan_tries = 3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] nvmeof_conn_info_version = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] nvmet_ns_id = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] nvmet_port_id = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] osapi_max_limit = 1000 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] osapi_volume_ext_list = [] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] osapi_volume_listen_port = 8776 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] osapi_volume_use_ssl = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] osapi_volume_workers = 2 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] per_volume_size_limit = -1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] periodic_fuzzy_delay = 60 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] periodic_interval = 60 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] public_endpoint = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] publish_errors = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] quota_backup_gigabytes = 1000 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] quota_backups = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] quota_gigabytes = 1000 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] quota_groups = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] quota_snapshots = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] quota_volumes = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 10:29:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83037) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] rate_limit_burst = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] rate_limit_except_level = CRITICAL {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] rate_limit_interval = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] reinit_driver_count = 3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] replication_device = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] report_discard_supported = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] report_interval = 120 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] reservation_clean_interval = 86400 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] reservation_expire = 86400 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] reserved_image_namespaces = [] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] reserved_percentage = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] rpc_response_timeout = 120 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] run_external_periodic_tasks = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] scst_target_driver = iscsi {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] scst_target_iqn_name = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] service_down_time = 720 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] shell_completion = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] snapshot_name_template = snapshot-%s {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] split_loggers = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] state_path = /opt/stack/data/cinder {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] storage_availability_zone = nova {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] storage_protocol = iSCSI {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] syslog_log_facility = LOG_USER {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] target_helper = lioadm {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] target_ip_address = 192.168.122.32 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] target_port = 3260 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] target_protocol = iscsi {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] target_secondary_ip_addresses = [] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] trace_flags = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] transport_url = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] until_refresh = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] use_chap_auth = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] use_default_quota_class = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] use_journal = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] use_json = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] use_multipath_for_image_xfer = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] use_stderr = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] use_syslog = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] verify_glance_signatures = enabled {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_api_class = cinder.volume.api.API {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_backend_name = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_clear = zero {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_clear_ionice = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_clear_size = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_copy_bps_limit = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_dd_blocksize = 1M {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_name_template = volume-%s {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_service_inithost_offload = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volume_usage_audit_period = month {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] zoning_mode = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_concurrency.disable_process_locking = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.admin_password = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.admin_token = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.admin_user = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.auth_port = 35357 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.auth_protocol = https {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.auth_section = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.auth_type = password {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.auth_uri = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.auth_version = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.cache = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.certfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.identity_uri = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.include_service_catalog = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.insecure = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.interface = public {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.keyfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_password = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcache_username = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.region_name = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.service_type = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.32/identity {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.backend = dogpile.cache.null {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.backend_argument = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.backend_expiration_time = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.config_prefix = cache.oslo {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.debug_cache_backend = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.enable_retry_client = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.enable_socket_keepalive = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.enabled = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.enforce_fips_mode = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.expiration_time = 600 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.hashclient_retry_attempts = 2 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.memcache_dead_retry = 300 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.memcache_pool_maxsize = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.memcache_sasl_enabled = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.password = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.proxies = [] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.redis_db = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.redis_server = localhost:6379 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.retry_attempts = 2 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.retry_delay = 0.0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.socket_keepalive_count = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.socket_keepalive_idle = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.socket_keepalive_interval = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.socket_timeout = 1.0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.tls_allowed_ciphers = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.tls_cafile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.tls_certfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.tls_enabled = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.tls_keyfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cache.username = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] coordination.backend_url = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.asyncio_connection = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.asyncio_slave_connection = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.backend = sqlalchemy {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.connection = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.connection_debug = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.connection_parameters = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.connection_recycle_time = 3600 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.connection_trace = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.db_inc_retry_interval = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.db_max_retries = 20 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.db_max_retry_interval = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.db_retry_interval = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.max_overflow = 50 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.max_pool_size = 5 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83037) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 10:29:56 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.quobyte [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 10:29:56 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.quobyte [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.max_retries = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.mysql_wsrep_sync_wait = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Running cmd (subprocess): mount.quobyte {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.pool_timeout = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.retry_interval = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.slave_connection = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.sqlite_synchronous = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.synchronous_reader = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] database.use_db_reconnect = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler.connection_string = messaging:// {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler.enabled = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler.es_doc_type = notification {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler.es_scroll_size = 10000 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler.es_scroll_time = 2m {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler.filter_error_trace = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler.hmac_keys = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler.sentinel_service_name = mymaster {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler.socket_timeout = 0.1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler.trace_requests = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler.trace_sqlalchemy = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler_jaeger.process_tags = {} {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler_jaeger.service_name_prefix = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] profiler_otlp.service_name_prefix = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_policy.enforce_new_defaults = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: WARNING oslo_config.cfg [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_policy.enforce_scope = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_policy.policy_default_rule = default {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_policy.policy_file = policy.yaml {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] privsep_osbrick.group = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] privsep_osbrick.helper_command = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] privsep_osbrick.user = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cinder_sys_admin.group = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cinder_sys_admin.helper_command = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] cinder_sys_admin.user = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] service_user.auth_section = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] service_user.auth_type = password {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] service_user.cafile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] service_user.certfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] service_user.collect_timing = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] service_user.insecure = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] service_user.keyfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] service_user.send_service_user_token = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] service_user.split_loggers = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] service_user.timeout = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance.auth_section = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance.auth_type = password {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance.certfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance.collect_timing = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance.insecure = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance.keyfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance.region_name = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance.split_loggers = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] glance.timeout = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.backend_availability_zone = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.chap_password = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.chap_username = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.disk_geometry = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.driver_client_cert = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.driver_client_cert_key = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.driver_data_namespace = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.driver_use_ssl = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.extra_capabilities = {} {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.filter_function = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.goodness_function = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.iscsi_target_flags = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.iscsi_write_cache = on {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.iser_helper = tgtadm {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.iser_ip_address = 192.168.122.32 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.iser_port = 3260 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nas_host = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nas_login = admin {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nas_mount_options = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nas_password = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nas_private_key = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nas_share_path = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.num_shell_tries = 3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.quobyte_volume_url = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.replication_device = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.report_discard_supported = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.reserved_percentage = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.target_helper = tgtadm {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.target_ip_address = 192.168.122.32 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.target_port = 3260 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.target_protocol = iscsi {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.trace_flags = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.unique_fqdn_network = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.use_chap_auth = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.volume_backend_name = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.volume_clear = zero {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.volume_clear_ionice = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.volume_clear_size = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_reports.file_event_handler = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_reports.log_dir = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.backend_availability_zone = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.backend_host = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.chap_password = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.chap_username = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.chiscsi_conf = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.disk_geometry = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.driver_client_cert = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.driver_data_namespace = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.driver_use_ssl = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.extra_capabilities = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.filter_function = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.goodness_function = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack quobyte-client[83062]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 10:29:56 devstack quobyte-client[83062]: Invalid parameters found, error: missing mount point. Apr 10 10:29:56 devstack quobyte-client[83062]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 10:29:56 devstack quobyte-client[83062]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.iser_helper = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.iser_ip_address = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.iser_port = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.iser_target_prefix = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nas_host = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nas_login = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nas_mount_options = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nas_password = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nas_private_key = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nas_share_path = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nas_ssh_port = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.num_shell_tries = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.nvmet_port_id = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.replication_device = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.report_discard_supported = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.reserved_percentage = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.scst_target_driver = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.storage_protocol = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.target_helper = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.target_ip_address = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.target_port = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.target_prefix = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.target_protocol = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.trace_flags = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] CMD "mount.quobyte" returned: 1 in 0.122s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.use_chap_auth = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.volume_clear = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:29:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.volume_clear_size = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:29:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] QuobyteHD.volumes_dir = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack sudo[83068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:29:56 devstack sudo[83068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.ssl = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_notifications.driver = [] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_notifications.retry = -1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] key_manager.fixed_key = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.barbican_api_version = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.barbican_endpoint = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.barbican_endpoint_type = public {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.barbican_region_name = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.cafile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.certfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.collect_timing = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.insecure = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.keyfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.number_of_retries = 60 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.retry_delay = 1 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.send_service_user_token = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.split_loggers = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.timeout = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.verify_ssl = True {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican.verify_ssl_path = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican_service_user.auth_section = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican_service_user.auth_type = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican_service_user.cafile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican_service_user.certfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican_service_user.collect_timing = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican_service_user.insecure = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican_service_user.keyfile = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican_service_user.split_loggers = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] barbican_service_user.timeout = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vault.approle_role_id = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vault.approle_secret_id = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vault.kv_mountpoint = secret {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vault.kv_path = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vault.kv_version = 2 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vault.namespace = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vault.root_token_id = **** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vault.ssl_ca_crt_file = None {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vault.timeout = 60.0 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vault.use_ssl = False {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:29:56 devstack cinder-volume[82863]: DEBUG oslo_service.backend._eventlet.service [None req-f31b3d02-034a-4870-8093-fce8147f30f7 None None] ******************************************************************************** {{(pid=82863) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 10:29:57 devstack sudo[83068]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:57 devstack cinder-volume[83037]: INFO cinder.volume.driver [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG cinder.volume.driver [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83037) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG oslo_db.sqlalchemy.engines [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83037) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writer thread running {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG cinder.db.sqlalchemy.api [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Building query based on filter {{(pid=83037) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83037) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:29:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:57 devstack cinder-volume[83037]: INFO cinder.keymgr.migration [None req-21c1c845-5568-4ed3-ad7f-c93c6bfc7dee None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 10:29:57 devstack sudo[83115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:29:57 devstack sudo[83115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:58 devstack sudo[83115]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.868s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:29:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Driver initialization completed successfully. Apr 10 10:29:58 devstack cinder-volume[83037]: INFO cinder.manager [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Initiating service 3 cleanup Apr 10 10:29:58 devstack cinder-volume[83037]: INFO cinder.manager [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Service 3 cleanup completed. Apr 10 10:29:58 devstack cinder-volume[83037]: DEBUG cinder.service [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Creating RPC server for service cinder-volume {{(pid=83037) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 10:29:58 devstack cinder-volume[83037]: DEBUG cinder.service [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83037) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 10:29:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 10:29:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:29:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:29:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:29:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:29:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:29:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:58 devstack sudo[83121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:29:58 devstack sudo[83121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:58 devstack sudo[83121]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.430s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e0e81788-dfe2-4068-85f8-c311f8401098 None None] Driver post RPC initialization completed successfully. Apr 10 10:30:06 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:30:08 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=2 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:30:08 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:30:57 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d3eb9c57-9879-4bf5-b21b-d402609ec68e tempest-GroupSnapshotsTest-1126085628 None] Group tempest-GroupSnapshotsTest-Group-1781528311: creating Apr 10 10:30:57 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d3eb9c57-9879-4bf5-b21b-d402609ec68e tempest-GroupSnapshotsTest-1126085628 None] Group tempest-GroupSnapshotsTest-Group-1781528311: created successfully Apr 10 10:30:57 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d3eb9c57-9879-4bf5-b21b-d402609ec68e tempest-GroupSnapshotsTest-1126085628 None] Create group completed successfully. Apr 10 10:30:57 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:30:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:30:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:30:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:30:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:30:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:30:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:57 devstack sudo[83423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:30:57 devstack sudo[83423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:58 devstack sudo[83423]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.662s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Flow 'volume_create_manager' (2ca7f8b6-aacf-49db-bf7c-54ae6c6cc7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66b889e-45e9-4883-8117-1c4a1d0e0110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66b889e-45e9-4883-8117-1c4a1d0e0110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2042282799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2473a990-0a21-4613-8861-0e5afe8e0b7b,host='devstack@QuobyteHD#QuobyteHD',id=09ad80af-1250-4c78-8c8a-bbe8ed570ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a177ea49e1146b698720d3523b6ac92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:30:58Z,use_quota=True,user_id='ffe2330e78ed47889e152ef59e544bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eff0330c-a99e-443b-b604-339e825ea76b),volume_type_id=eff0330c-a99e-443b-b604-339e825ea76b)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9fa861-f3f2-472a-8109-b6012d1634e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9fa861-f3f2-472a-8109-b6012d1634e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdc0beb-6667-4143-9873-7655f335bdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdc0beb-6667-4143-9873-7655f335bdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ad80af-1250-4c78-8c8a-bbe8ed570ab7', 'volume_name': 'volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44ef529-8ca5-4f39-b817-f2bfefc92f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44ef529-8ca5-4f39-b817-f2bfefc92f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2341a8b-a1e9-4237-a332-57119d079a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:30:58 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Volume 09ad80af-1250-4c78-8c8a-bbe8ed570ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7', 'volume_size': 1} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2473a990-0a21-4613-8861-0e5afe8e0b7b,created_at=2026-04-10T08:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2042282799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2473a990-0a21-4613-8861-0e5afe8e0b7b,host='devstack@QuobyteHD#QuobyteHD',id=09ad80af-1250-4c78-8c8a-bbe8ed570ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a177ea49e1146b698720d3523b6ac92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:30:58Z,use_quota=True,user_id='ffe2330e78ed47889e152ef59e544bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eff0330c-a99e-443b-b604-339e825ea76b),volume_type_id=eff0330c-a99e-443b-b604-339e825ea76b)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Creating volume 09ad80af-1250-4c78-8c8a-bbe8ed570ab7 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:30:58 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:30:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:58 devstack sudo[83428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 1073741824 Apr 10 10:30:58 devstack sudo[83428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:59 devstack sudo[83428]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 1073741824" returned: 0 in 0.676s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:59 devstack sudo[83746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 Apr 10 10:30:59 devstack sudo[83746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:59 devstack sudo[83746]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" returned: 0 in 0.552s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:30:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:30:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2341a8b-a1e9-4237-a332-57119d079a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:30:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986de10d-3f2d-491f-9c87-341d35a1a366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:30:59 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Volume volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 (09ad80af-1250-4c78-8c8a-bbe8ed570ab7): created successfully Apr 10 10:30:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986de10d-3f2d-491f-9c87-341d35a1a366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:30:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Flow 'volume_create_manager' (2ca7f8b6-aacf-49db-bf7c-54ae6c6cc7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:30:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0594b3c9-0b70-4022-9ada-b0336eed5165 tempest-GroupSnapshotsTest-1126085628 None] Created volume successfully. Apr 10 10:31:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] GroupSnapshot 4ba91591-6cfd-44eb-900b-d103276356b3: creating. Apr 10 10:31:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Group snapshot 4ba91591-6cfd-44eb-900b-d103276356b3: creating. {{(pid=83037) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:31:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Creating offline snapshot a8c44823-5f3c-4867-b67c-accfe250cc8c of volume 09ad80af-1250-4c78-8c8a-bbe8ed570ab7 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:31:00 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1r323sjy/privsep.sock'] Apr 10 10:31:00 devstack sudo[83749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1r323sjy/privsep.sock Apr 10 10:31:00 devstack sudo[83749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:31:01 devstack cinder-volume[83037]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 10 10:31:02 devstack sudo[83749]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:02 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Spawned new privsep daemon via rootwrap Apr 10 10:31:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Accepted privsep connection to /tmp/tmp1r323sjy/privsep.sock {{(pid=83037) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 10 10:31:02 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 10 10:31:02 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 10 10:31:02 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 10 10:31:02 devstack cinder-volume[83037]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83755 Apr 10 10:31:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef56aa6-bebb-4256-a1b9-7de372c8aac4]: (2,) {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2064ace-d778-427c-9da5-99a29f530c0c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:02 devstack sudo[83757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 Apr 10 10:31:02 devstack sudo[83757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:03 devstack sudo[83757]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" returned: 0 in 0.711s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:03 devstack sudo[83764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c 1G Apr 10 10:31:03 devstack sudo[83764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:04 devstack sudo[83764]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c 1G" returned: 0 in 1.233s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:04 devstack sudo[83772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c Apr 10 10:31:04 devstack sudo[83772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:05 devstack sudo[83772]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c" returned: 0 in 0.656s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:05 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:31:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:05 devstack sudo[83779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c Apr 10 10:31:05 devstack sudo[83779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:06 devstack sudo[83779]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c" returned: 0 in 1.095s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:06 devstack sudo[83784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.info Apr 10 10:31:06 devstack sudo[83784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:07 devstack sudo[83784]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.info" returned: 0 in 0.749s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:07 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:31:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:07 devstack sudo[83787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.info Apr 10 10:31:07 devstack sudo[83787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:08 devstack sudo[83787]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.info" returned: 0 in 1.022s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.205s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1b33d9d0-4768-41d3-8105-82c453648308 tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 4ba91591-6cfd-44eb-900b-d103276356b3: created successfully Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Flow 'volume_create_manager' (4cc14d3b-1c5c-4239-bcd6-8b15df54c265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41977201-d375-4cd5-8b3d-a8a4f608129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41977201-d375-4cd5-8b3d-a8a4f608129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-179616849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a6d069-a296-463a-83f1-3d71dc2c4c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c196cb329004b06980f6c4e5fd77860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:09Z,use_quota=True,user_id='577b9db3bc7a42a8999396b27aec1723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b34eaff-f7fe-4834-849c-381d366b60f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b34eaff-f7fe-4834-849c-381d366b60f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b51722-b4f4-4da3-9552-d95ae02232b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b51722-b4f4-4da3-9552-d95ae02232b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a6d069-a296-463a-83f1-3d71dc2c4c76', 'volume_name': 'volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7a69d5-a817-45a4-a0da-31162e9a46a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7a69d5-a817-45a4-a0da-31162e9a46a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efce1660-91bb-427b-aacf-a3ec4611b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Volume c6a6d069-a296-463a-83f1-3d71dc2c4c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76', 'volume_size': 1} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-179616849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a6d069-a296-463a-83f1-3d71dc2c4c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c196cb329004b06980f6c4e5fd77860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:09Z,use_quota=True,user_id='577b9db3bc7a42a8999396b27aec1723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Creating volume c6a6d069-a296-463a-83f1-3d71dc2c4c76 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:31:09 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:31:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:09 devstack sudo[83792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76 1073741824 Apr 10 10:31:09 devstack sudo[83792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:10 devstack sudo[83792]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76 1073741824" returned: 0 in 1.366s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:10 devstack sudo[83820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76 Apr 10 10:31:10 devstack sudo[83820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:11 devstack sudo[83820]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76" returned: 0 in 0.521s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.044s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-a8c44823-5f3c-4867-b67c-accfe250cc8c-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efce1660-91bb-427b-aacf-a3ec4611b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ebad16-7811-4106-86da-2a3a44228e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Volume volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76 (c6a6d069-a296-463a-83f1-3d71dc2c4c76): created successfully Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ebad16-7811-4106-86da-2a3a44228e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Flow 'volume_create_manager' (4cc14d3b-1c5c-4239-bcd6-8b15df54c265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-a8c44823-5f3c-4867-b67c-accfe250cc8c-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Creating volume 3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 from snapshot a8c44823-5f3c-4867-b67c-accfe250cc8c {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:31:11 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2fda91ca-a9cd-4a3e-8332-5d657561bcf8 tempest-VolumesAdminNegativeTest-547398585 None] Created volume successfully. Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] snapshot: a8c44823-5f3c-4867-b67c-accfe250cc8c, volume: 3ce1f031-80b5-48e8-8bcb-40135ff7a4b6, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8eccba-2014-407b-9f58-5f01279a5899]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:11 devstack sudo[83823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c Apr 10 10:31:11 devstack sudo[83823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:12 devstack sudo[83823]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c" returned: 0 in 0.699s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:31:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:31:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:31:12 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2735234b-ca40-439d-aabd-8e7e997297b8]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:12 devstack sudo[83835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 Apr 10 10:31:12 devstack sudo[83835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:12 devstack sudo[83835]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Acquiring lock "cinder-c6a6d069-a296-463a-83f1-3d71dc2c4c76-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:31:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" returned: 0 in 0.774s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:12 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:31:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Lock "cinder-c6a6d069-a296-463a-83f1-3d71dc2c4c76-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:31:12 devstack sudo[83840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 Apr 10 10:31:12 devstack sudo[83840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Acquiring lock "cinder-quobyte-c6a6d069-a296-463a-83f1-3d71dc2c4c76" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:31:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Lock "cinder-quobyte-c6a6d069-a296-463a-83f1-3d71dc2c4c76" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:31:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[370cad26-9084-4dac-a38b-a7af7b5e6356]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:13 devstack sudo[83842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76 Apr 10 10:31:13 devstack sudo[83842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:14 devstack sudo[83842]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76" returned: 0 in 1.664s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:14 devstack sudo[83871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76 Apr 10 10:31:14 devstack sudo[83871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:18 devstack sudo[83871]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c6a6d069-a296-463a-83f1-3d71dc2c4c76" returned: 0 in 3.315s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Lock "cinder-quobyte-c6a6d069-a296-463a-83f1-3d71dc2c4c76" released by "delete_volume" :: held 5.048s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:31:18 devstack cinder-volume[83037]: WARNING cinder.quota [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:31:18 devstack cinder-volume[83037]: WARNING cinder.quota [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:31:18 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Created reservations ['a64ce821-f48d-475d-ac46-06f8f7592b51', '02378b16-37bc-4261-b2eb-dcc5051032d0', '985e38ba-d251-4b7a-925c-7fd0a5515294', '0ef13c53-0880-4f8d-9d7d-d1934fc26e74'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:31:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:18 devstack sudo[83919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:31:18 devstack sudo[83919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:19 devstack sudo[83840]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" returned: 0 in 6.091s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[376b0f85-805b-41df-b449-f9912d459073]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:19 devstack sudo[83923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 Apr 10 10:31:19 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:19 devstack sudo[83919]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 1.163s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:19 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:31:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Deleted volume successfully. Apr 10 10:31:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-41cbbe98-4755-4075-8f92-22cab2ad9d0c tempest-VolumesAdminNegativeTest-547398585 None] Lock "cinder-c6a6d069-a296-463a-83f1-3d71dc2c4c76-delete_volume" released by "delete_volume" :: held 7.022s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:31:20 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" returned: 0 in 1.824s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:20 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:31:20 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Converted 1024.00 MB image at 168.04 MB/s Apr 10 10:31:20 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:31:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:20 devstack sudo[83938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 Apr 10 10:31:20 devstack sudo[83938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:21 devstack sudo[83938]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" returned: 0 in 1.044s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" released by "_copy_volume_from_snapshot" :: held 10.556s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:31:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-a8c44823-5f3c-4867-b67c-accfe250cc8c-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" released by "_create_volume_from_snapshot" :: held 10.603s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:31:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.647s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:22 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-375abc8a-98e8-47e5-a456-b69ed9b8e15f tempest-GroupSnapshotsTest-1126085628 None] Create group from source-snapshot-4ba91591-6cfd-44eb-900b-d103276356b3 completed successfully. Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Flow 'volume_create_manager' (a82aa044-54ba-4a88-97ee-6297ea0c4804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93771b2d-431e-4ed4-b6fb-dcf0c12e6337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93771b2d-431e-4ed4-b6fb-dcf0c12e6337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-572530544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e905359-23aa-4493-8b08-938932b5feb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e809b3054c4d9bbb781ceb9b9c73f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:23Z,use_quota=True,user_id='83e49df57ca54c58b9ba2b4c8388868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c97f89-496c-43aa-bd1f-041a6d8e2381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c97f89-496c-43aa-bd1f-041a6d8e2381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5be305-e4c1-4a2a-a311-8d06deabbd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5be305-e4c1-4a2a-a311-8d06deabbd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e905359-23aa-4493-8b08-938932b5feb7', 'volume_name': 'volume-7e905359-23aa-4493-8b08-938932b5feb7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853f95ec-56d6-4c45-871f-c0ee2612258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853f95ec-56d6-4c45-871f-c0ee2612258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ea8e75-45ea-452d-a375-574a2f856eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:22 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Volume 7e905359-23aa-4493-8b08-938932b5feb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e905359-23aa-4493-8b08-938932b5feb7', 'volume_size': 1} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-572530544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e905359-23aa-4493-8b08-938932b5feb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e809b3054c4d9bbb781ceb9b9c73f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:23Z,use_quota=True,user_id='83e49df57ca54c58b9ba2b4c8388868a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Creating volume 7e905359-23aa-4493-8b08-938932b5feb7 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:31:22 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:31:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:22 devstack sudo[83970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7 1073741824 Apr 10 10:31:22 devstack sudo[83970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:31:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" acquired by "delete_volume" :: waited 0.066s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:31:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[81871450-ecef-4f29-8c8f-d35e0dc64857]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:24 devstack sudo[83978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 Apr 10 10:31:24 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:24 devstack sudo[83970]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7 1073741824" returned: 0 in 1.511s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:24 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" returned: 0 in 0.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:24 devstack sudo[83983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7 Apr 10 10:31:24 devstack sudo[83983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:24 devstack sudo[83985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6 Apr 10 10:31:24 devstack sudo[83985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:24 devstack sudo[83983]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7" returned: 0 in 0.498s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:31:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ea8e75-45ea-452d-a375-574a2f856eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e905359-23aa-4493-8b08-938932b5feb7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45256001-86b3-49df-9184-b593070e9c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:25 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Volume volume-7e905359-23aa-4493-8b08-938932b5feb7 (7e905359-23aa-4493-8b08-938932b5feb7): created successfully Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45256001-86b3-49df-9184-b593070e9c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Flow 'volume_create_manager' (a82aa044-54ba-4a88-97ee-6297ea0c4804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:31:25 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f0a08db1-c8fe-4d01-b9f6-a22256ca82db tempest-ServerRescueNegativeTestJSON-1260655 None] Created volume successfully. Apr 10 10:31:25 devstack sudo[83985]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" returned: 0 in 0.862s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-3ce1f031-80b5-48e8-8bcb-40135ff7a4b6" released by "delete_volume" :: held 1.554s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['79662096-6af9-45eb-a6ca-5867afb4e0d6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:31:25 devstack cinder-volume[83037]: WARNING cinder.quota [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1667063781 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1667063781, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:31:25 devstack cinder-volume[83037]: WARNING cinder.quota [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1667063781 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1667063781, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['95f07df1-82b0-46b1-91c3-f108b82130ca', '64cfea25-894a-4b5d-b4ec-7f0859d3546d', 'd9a1792b-9db9-4ea6-b883-7b87f24dd92f', '467ba94b-cb40-4cb7-b8e2-97d858dff194'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:25 devstack sudo[83990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:31:25 devstack sudo[83990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:26 devstack sudo[83990]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.649s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:26 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:31:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ea14fb55-35ef-44ea-af55-6439f4cbaa7a tempest-GroupSnapshotsTest-1126085628 None] Delete group completed successfully. Apr 10 10:31:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 4ba91591-6cfd-44eb-900b-d103276356b3: deleting Apr 10 10:31:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 4ba91591-6cfd-44eb-900b-d103276356b3: deleting {{(pid=83037) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:31:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:31:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:31:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-a8c44823-5f3c-4867-b67c-accfe250cc8c" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:31:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-a8c44823-5f3c-4867-b67c-accfe250cc8c" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:31:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Deleting offline snapshot a8c44823-5f3c-4867-b67c-accfe250cc8c of volume 09ad80af-1250-4c78-8c8a-bbe8ed570ab7 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:31:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] snapshot_file for this snap is: volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:31:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bae2a5c-2e21-412a-9c4c-5c1cd5daa55e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:26 devstack sudo[83993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c Apr 10 10:31:26 devstack sudo[83993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:27 devstack sudo[83993]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c" returned: 0 in 1.121s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:31:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a939c8b8-b72c-487b-949b-2d4195839183]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:27 devstack sudo[84036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 Apr 10 10:31:27 devstack sudo[84036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:29 devstack sudo[84036]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" returned: 0 in 1.397s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:29 devstack sudo[84073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c Apr 10 10:31:29 devstack sudo[84073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:30 devstack sudo[84073]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c" returned: 0 in 1.250s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:30 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c Apr 10 10:31:30 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:31 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7.a8c44823-5f3c-4867-b67c-accfe250cc8c" returned: 0 in 0.961s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-a8c44823-5f3c-4867-b67c-accfe250cc8c" released by "_delete_snapshot" :: held 5.010s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:31:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" released by "delete_snapshot" :: held 5.061s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:31:31 devstack cinder-volume[83037]: WARNING cinder.quota [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1667063781 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1667063781, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:31:31 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['9f520514-c06e-45c4-b07c-e223ba140232', 'b20c0325-cdd5-490c-b19f-05664a36bcb8', 'bbccf0c3-de25-46eb-9c76-ac61748ff842', 'aea824f0-0c30-420e-823a-7edc259bde28'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:31:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-69c91e5e-5c57-4b1e-b8e7-b5548c8368cb tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 4ba91591-6cfd-44eb-900b-d103276356b3: deleted successfully Apr 10 10:31:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:31:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" acquired by "delete_volume" :: waited 0.027s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:31:32 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d54f2-f49e-4ae9-9c30-ae1dda9fa669]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:33 devstack sudo[84117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 Apr 10 10:31:33 devstack sudo[84117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:34 devstack sudo[84117]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" returned: 0 in 1.439s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:34 devstack sudo[84122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7 Apr 10 10:31:34 devstack sudo[84122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:35 devstack sudo[84122]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" returned: 0 in 0.967s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-09ad80af-1250-4c78-8c8a-bbe8ed570ab7" released by "delete_volume" :: held 2.687s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:31:35 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['a4599877-da9b-461e-b01d-a3eb5ca71b41'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:31:35 devstack cinder-volume[83037]: WARNING cinder.db.sqlalchemy.api [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1667063781'] Apr 10 10:31:35 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['2b8b4df8-a4c8-434a-bf22-46d53f168794', '0f3c4904-2780-4686-bff7-efba1ddd984f', '9ac2789b-293e-4822-be0e-694865b31750', 'aa25a02f-9fd1-40cc-8a53-8e0b4eeefe17'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:31:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:35 devstack sudo[84126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:31:35 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:36 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.949s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:36 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:31:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a94a8ee1-7ac9-4d1a-8712-6dfb5a364361 tempest-GroupSnapshotsTest-1126085628 None] Delete group completed successfully. Apr 10 10:31:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-81cb0ac6-9dbd-444f-9f02-0873aa8e833a tempest-GroupSnapshotsTest-1126085628 None] Group tempest-GroupSnapshotsTest-Group-570257973: creating Apr 10 10:31:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-81cb0ac6-9dbd-444f-9f02-0873aa8e833a tempest-GroupSnapshotsTest-1126085628 None] Group tempest-GroupSnapshotsTest-Group-570257973: created successfully Apr 10 10:31:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-81cb0ac6-9dbd-444f-9f02-0873aa8e833a tempest-GroupSnapshotsTest-1126085628 None] Create group completed successfully. Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Flow 'volume_create_manager' (8c28a3d6-d9c8-49a3-a4eb-f6947f4dd203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74139105-7c4f-49a0-8f1c-17f50fcf21c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74139105-7c4f-49a0-8f1c-17f50fcf21c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537185662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=871b42b5-219c-4b06-a453-a38bf35531d3,host='devstack@QuobyteHD#QuobyteHD',id=68f28349-46af-4e33-8a99-84cbdded0170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a177ea49e1146b698720d3523b6ac92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:39Z,use_quota=True,user_id='ffe2330e78ed47889e152ef59e544bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad0425b-3535-426d-8c59-0136b47c0db3),volume_type_id=fad0425b-3535-426d-8c59-0136b47c0db3)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e5facd-ccc6-4f73-8522-44c30b6264eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e5facd-ccc6-4f73-8522-44c30b6264eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a320fd-2e87-4232-bf8c-21a20dbc72fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a320fd-2e87-4232-bf8c-21a20dbc72fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f28349-46af-4e33-8a99-84cbdded0170', 'volume_name': 'volume-68f28349-46af-4e33-8a99-84cbdded0170', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b5210b-e407-4484-b724-4604b45d35ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b5210b-e407-4484-b724-4604b45d35ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcca432e-62e2-41a7-800b-27f59de65b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Volume 68f28349-46af-4e33-8a99-84cbdded0170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f28349-46af-4e33-8a99-84cbdded0170', 'volume_size': 1} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=871b42b5-219c-4b06-a453-a38bf35531d3,created_at=2026-04-10T08:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537185662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=871b42b5-219c-4b06-a453-a38bf35531d3,host='devstack@QuobyteHD#QuobyteHD',id=68f28349-46af-4e33-8a99-84cbdded0170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a177ea49e1146b698720d3523b6ac92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:39Z,use_quota=True,user_id='ffe2330e78ed47889e152ef59e544bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad0425b-3535-426d-8c59-0136b47c0db3),volume_type_id=fad0425b-3535-426d-8c59-0136b47c0db3)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Creating volume 68f28349-46af-4e33-8a99-84cbdded0170 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:31:39 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:31:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:39 devstack sudo[84158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 1073741824 Apr 10 10:31:39 devstack sudo[84158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:41 devstack sudo[84158]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 1073741824" returned: 0 in 2.026s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:41 devstack sudo[84178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 Apr 10 10:31:41 devstack sudo[84178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:43 devstack sudo[84178]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170" returned: 0 in 1.280s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] <== create_volume: return (3423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:31:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.446s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcca432e-62e2-41a7-800b-27f59de65b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f28349-46af-4e33-8a99-84cbdded0170', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17cdc88f-e0c2-4ae2-ab69-542ec03fe287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:43 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Volume volume-68f28349-46af-4e33-8a99-84cbdded0170 (68f28349-46af-4e33-8a99-84cbdded0170): created successfully Apr 10 10:31:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17cdc88f-e0c2-4ae2-ab69-542ec03fe287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Flow 'volume_create_manager' (8c28a3d6-d9c8-49a3-a4eb-f6947f4dd203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:31:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6cd7168b-12eb-4a27-b3a7-2f39aeaa9b64 tempest-GroupSnapshotsTest-1126085628 None] Created volume successfully. Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Flow 'volume_create_manager' (2455f6f3-29d8-4f78-a6b1-54a4954177d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f98b23-8444-4c96-9572-ba5bc438a56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2f98b23-8444-4c96-9572-ba5bc438a56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821263151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=871b42b5-219c-4b06-a453-a38bf35531d3,host='devstack@QuobyteHD#QuobyteHD',id=61aac9cb-6db7-4361-95e3-f762119f9e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a177ea49e1146b698720d3523b6ac92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:45Z,use_quota=True,user_id='ffe2330e78ed47889e152ef59e544bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad0425b-3535-426d-8c59-0136b47c0db3),volume_type_id=fad0425b-3535-426d-8c59-0136b47c0db3)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf02ff9b-e69f-440a-ba23-e8d736fec1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf02ff9b-e69f-440a-ba23-e8d736fec1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240a1235-ab5e-454f-87bf-704418985db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240a1235-ab5e-454f-87bf-704418985db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61aac9cb-6db7-4361-95e3-f762119f9e65', 'volume_name': 'volume-61aac9cb-6db7-4361-95e3-f762119f9e65', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1b69ee-146e-4155-87fc-f70acb535e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1b69ee-146e-4155-87fc-f70acb535e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdc06c0-cb33-4b09-9e6b-fd847c78902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Volume 61aac9cb-6db7-4361-95e3-f762119f9e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61aac9cb-6db7-4361-95e3-f762119f9e65', 'volume_size': 1} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=871b42b5-219c-4b06-a453-a38bf35531d3,created_at=2026-04-10T08:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821263151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=871b42b5-219c-4b06-a453-a38bf35531d3,host='devstack@QuobyteHD#QuobyteHD',id=61aac9cb-6db7-4361-95e3-f762119f9e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a177ea49e1146b698720d3523b6ac92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:31:45Z,use_quota=True,user_id='ffe2330e78ed47889e152ef59e544bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fad0425b-3535-426d-8c59-0136b47c0db3),volume_type_id=fad0425b-3535-426d-8c59-0136b47c0db3)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Creating volume 61aac9cb-6db7-4361-95e3-f762119f9e65 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:31:44 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:31:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:44 devstack sudo[84184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 1073741824 Apr 10 10:31:44 devstack sudo[84184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:46 devstack sudo[84184]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 1073741824" returned: 0 in 1.372s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:46 devstack sudo[84236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 Apr 10 10:31:46 devstack sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:47 devstack sudo[84236]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65" returned: 0 in 1.214s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] <== create_volume: return (2627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:31:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.631s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdc06c0-cb33-4b09-9e6b-fd847c78902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61aac9cb-6db7-4361-95e3-f762119f9e65', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba33e322-5499-4fe6-b0f4-19b7906d7708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:31:47 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Volume volume-61aac9cb-6db7-4361-95e3-f762119f9e65 (61aac9cb-6db7-4361-95e3-f762119f9e65): created successfully Apr 10 10:31:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba33e322-5499-4fe6-b0f4-19b7906d7708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:31:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Flow 'volume_create_manager' (2455f6f3-29d8-4f78-a6b1-54a4954177d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:31:47 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2243bfaa-39c4-4bae-88dc-413abe00a193 tempest-GroupSnapshotsTest-1126085628 None] Created volume successfully. Apr 10 10:31:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Acquiring lock "cinder-7e905359-23aa-4493-8b08-938932b5feb7-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:31:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Lock "cinder-7e905359-23aa-4493-8b08-938932b5feb7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:31:48 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=57,cinder:UPDATE=61,cinder:INSERT=12,cinder:DELETE=2 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:31:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Acquiring lock "cinder-quobyte-7e905359-23aa-4493-8b08-938932b5feb7" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:31:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Lock "cinder-quobyte-7e905359-23aa-4493-8b08-938932b5feb7" acquired by "delete_volume" :: waited 0.025s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:31:48 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd5b7e8-a061-4f2e-a551-2681ddf1ae48]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:48 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=55,cinder:UPDATE=52,cinder:DELETE=4,cinder:INSERT=12 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:31:48 devstack sudo[84253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7 Apr 10 10:31:48 devstack sudo[84253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c98cffdf-42ea-41d0-a5ff-a58fa0a49b73 tempest-GroupSnapshotsTest-1126085628 None] Update group completed successfully. Apr 10 10:31:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b21104a3-9f59-4339-bbd1-bb155fb3e3e9 tempest-GroupSnapshotsTest-1126085628 None] Update group completed successfully. Apr 10 10:31:50 devstack sudo[84253]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7" returned: 0 in 2.111s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:50 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7 Apr 10 10:31:50 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-04226a40-fe49-458d-9ea8-0587327c7623 tempest-GroupSnapshotsTest-1126085628 None] Update group completed successfully. Apr 10 10:31:51 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7e905359-23aa-4493-8b08-938932b5feb7" returned: 0 in 0.939s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Lock "cinder-quobyte-7e905359-23aa-4493-8b08-938932b5feb7" released by "delete_volume" :: held 3.227s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:31:51 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Created reservations ['724e6fa2-0229-4806-b0c9-d7dcc165c6b9', 'f0891263-e4dc-4531-8949-12e8724e1598', '8e8f9eb0-0128-48d8-b481-56148f4dfe52', '60e6d58c-8b0c-42dc-9dab-806050f0f718'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:31:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:52 devstack sudo[84286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:31:52 devstack sudo[84286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a1c5f8aa-595b-4e2a-a447-e4a28dc34e70 tempest-GroupSnapshotsTest-1126085628 None] Update group completed successfully. Apr 10 10:31:53 devstack sudo[84286]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 1.219s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:53 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:31:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Deleted volume successfully. Apr 10 10:31:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8dafdfe8-e5e0-41b9-8d7f-b655c523fb30 tempest-ServerRescueNegativeTestJSON-1260655 None] Lock "cinder-7e905359-23aa-4493-8b08-938932b5feb7-delete_volume" released by "delete_volume" :: held 4.887s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:31:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] GroupSnapshot 9d46902f-3370-40d0-9729-6ff8f2149254: creating. Apr 10 10:31:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Group snapshot 9d46902f-3370-40d0-9729-6ff8f2149254: creating. {{(pid=83037) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:31:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Creating offline snapshot 17747fc9-f8ec-4422-a451-eee78aff3e57 of volume 61aac9cb-6db7-4361-95e3-f762119f9e65 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:31:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[528120ca-6e41-4f84-a92a-5f5135791a5c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:31:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:55 devstack sudo[84345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 Apr 10 10:31:55 devstack sudo[84345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:56 devstack sudo[84345]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65" returned: 0 in 1.503s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:56 devstack sudo[84352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 1G Apr 10 10:31:56 devstack sudo[84352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:57 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:31:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:57 devstack sudo[84359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:31:57 devstack sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:58 devstack sudo[84359]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.617s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:31:58 devstack sudo[84352]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 1G" returned: 0 in 1.872s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61aac9cb-6db7-4361-95e3-f762119f9e65 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:58 devstack sudo[84363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61aac9cb-6db7-4361-95e3-f762119f9e65 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 Apr 10 10:31:58 devstack sudo[84363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:59 devstack sudo[84363]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61aac9cb-6db7-4361-95e3-f762119f9e65 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57" returned: 0 in 0.701s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:59 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:31:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:59 devstack sudo[84369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 Apr 10 10:31:59 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:59 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57" returned: 0 in 0.841s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:59 devstack sudo[84372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.info Apr 10 10:31:59 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:01 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.info" returned: 0 in 1.385s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:01 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:32:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:01 devstack sudo[84375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.info Apr 10 10:32:01 devstack sudo[84375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:01 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Flow 'volume_create_manager' (b49d2609-41ca-4415-bb0a-eb126fa90b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3bdefa-b989-40ac-998e-191e60660574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3bdefa-b989-40ac-998e-191e60660574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1609127510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a57464d-d34a-42ad-bbd9-b35e6c22d221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a22290c438945b39bb98015fafa8857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:02Z,use_quota=True,user_id='c1b7ac7ba1ef4a0a8c0fad5d499e5eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a800678-f425-4a76-b258-762554941325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a800678-f425-4a76-b258-762554941325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93476393-7bfe-41d7-9414-54f75bf2d81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93476393-7bfe-41d7-9414-54f75bf2d81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a57464d-d34a-42ad-bbd9-b35e6c22d221', 'volume_name': 'volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52df18eb-d576-4ac7-972e-ab6008cef285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52df18eb-d576-4ac7-972e-ab6008cef285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704f2701-8d66-4377-8c60-3f2da149d459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:02 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Volume 0a57464d-d34a-42ad-bbd9-b35e6c22d221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221', 'volume_size': 1} Apr 10 10:32:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:02 devstack sudo[84375]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.info" returned: 0 in 1.070s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.641s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Creating offline snapshot ab288b1d-d490-4fcc-a09d-709a7b02187f of volume 68f28349-46af-4e33-8a99-84cbdded0170 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:32:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0923b9a-246c-44d5-b9d5-32905192ca88]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:02 devstack sudo[84392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 Apr 10 10:32:02 devstack sudo[84392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:03 devstack sudo[84392]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170" returned: 0 in 1.218s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:03 devstack sudo[84404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f 1G Apr 10 10:32:03 devstack sudo[84404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:04 devstack sudo[84404]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f 1G" returned: 0 in 0.903s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f28349-46af-4e33-8a99-84cbdded0170 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:04 devstack sudo[84435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f28349-46af-4e33-8a99-84cbdded0170 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f Apr 10 10:32:04 devstack sudo[84435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:05 devstack sudo[84435]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68f28349-46af-4e33-8a99-84cbdded0170 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f" returned: 0 in 0.702s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:05 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:32:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:05 devstack sudo[84441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f Apr 10 10:32:05 devstack sudo[84441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:05 devstack sudo[84441]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f" returned: 0 in 0.637s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:06 devstack sudo[84445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.info Apr 10 10:32:06 devstack sudo[84445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:06 devstack sudo[84445]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.info" returned: 0 in 0.656s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:06 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:32:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:06 devstack sudo[84448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.info Apr 10 10:32:06 devstack sudo[84448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:07 devstack sudo[84448]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.info" returned: 0 in 0.646s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.855s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.304s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1609127510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a57464d-d34a-42ad-bbd9-b35e6c22d221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a22290c438945b39bb98015fafa8857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:02Z,use_quota=True,user_id='c1b7ac7ba1ef4a0a8c0fad5d499e5eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Creating volume 0a57464d-d34a-42ad-bbd9-b35e6c22d221 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:07 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:07 devstack sudo[84451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221 1073741824 Apr 10 10:32:07 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b41116a1-df33-4624-9c51-e126fa049639 tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 9d46902f-3370-40d0-9729-6ff8f2149254: created successfully Apr 10 10:32:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 9d46902f-3370-40d0-9729-6ff8f2149254: deleting Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 9d46902f-3370-40d0-9729-6ff8f2149254: deleting {{(pid=83037) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-61aac9cb-6db7-4361-95e3-f762119f9e65" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-61aac9cb-6db7-4361-95e3-f762119f9e65" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-17747fc9-f8ec-4422-a451-eee78aff3e57" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-17747fc9-f8ec-4422-a451-eee78aff3e57" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Deleting offline snapshot 17747fc9-f8ec-4422-a451-eee78aff3e57 of volume 61aac9cb-6db7-4361-95e3-f762119f9e65 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] snapshot_file for this snap is: volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[028328f3-302c-46fb-8916-1e094f2c6f2d]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:08 devstack sudo[84456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 Apr 10 10:32:08 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:08 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221 1073741824" returned: 0 in 1.005s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:08 devstack sudo[84458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221 Apr 10 10:32:08 devstack sudo[84458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:08 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57" returned: 0 in 1.016s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61aac9cb-6db7-4361-95e3-f762119f9e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:32:08 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0185bf-69b9-425f-90fc-a793b6905608]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:09 devstack sudo[84458]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221" returned: 0 in 0.692s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704f2701-8d66-4377-8c60-3f2da149d459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:09 devstack sudo[84464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 Apr 10 10:32:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c07b23b-033d-4b99-a723-05dda65e1b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:09 devstack sudo[84464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Volume volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221 (0a57464d-d34a-42ad-bbd9-b35e6c22d221): created successfully Apr 10 10:32:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c07b23b-033d-4b99-a723-05dda65e1b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Flow 'volume_create_manager' (b49d2609-41ca-4415-bb0a-eb126fa90b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-df6737f1-88d2-4346-8bb8-3a316c48230c tempest-ServersNegativeTestJSON-1087412955 None] Created volume successfully. Apr 10 10:32:09 devstack sudo[84464]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65" returned: 0 in 0.789s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:09 devstack sudo[84469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 Apr 10 10:32:09 devstack sudo[84469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:10 devstack sudo[84469]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57" returned: 0 in 0.713s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:10 devstack sudo[84475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57 Apr 10 10:32:10 devstack sudo[84475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:11 devstack sudo[84475]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65.17747fc9-f8ec-4422-a451-eee78aff3e57" returned: 0 in 0.789s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-17747fc9-f8ec-4422-a451-eee78aff3e57" released by "_delete_snapshot" :: held 3.423s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-61aac9cb-6db7-4361-95e3-f762119f9e65" released by "delete_snapshot" :: held 3.469s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-68f28349-46af-4e33-8a99-84cbdded0170" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-68f28349-46af-4e33-8a99-84cbdded0170" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-ab288b1d-d490-4fcc-a09d-709a7b02187f" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-ab288b1d-d490-4fcc-a09d-709a7b02187f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Deleting offline snapshot ab288b1d-d490-4fcc-a09d-709a7b02187f of volume 68f28349-46af-4e33-8a99-84cbdded0170 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:32:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] snapshot_file for this snap is: volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:32:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef93e44-8791-4779-8304-0d57d1df02b6]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:11 devstack sudo[84479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f Apr 10 10:32:11 devstack sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:12 devstack sudo[84479]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f" returned: 0 in 1.021s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68f28349-46af-4e33-8a99-84cbdded0170(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:32:12 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba90e8a-d85f-4653-9f62-a8d914c99912]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:12 devstack sudo[84485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 Apr 10 10:32:12 devstack sudo[84485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Flow 'volume_create_manager' (e1953931-a961-4200-8e82-8b3876bfbb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d69c18-1ade-4a74-b75b-aaa4cfbd39b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d69c18-1ade-4a74-b75b-aaa4cfbd39b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1479678105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333c74da-8ef5-4f13-88fc-831b87dce381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a22290c438945b39bb98015fafa8857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:13Z,use_quota=True,user_id='c1b7ac7ba1ef4a0a8c0fad5d499e5eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018c98e4-6a85-4d6e-bbd1-f453c1561bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018c98e4-6a85-4d6e-bbd1-f453c1561bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d1b679-b414-4e10-a9c1-775395e87f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d1b679-b414-4e10-a9c1-775395e87f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '333c74da-8ef5-4f13-88fc-831b87dce381', 'volume_name': 'volume-333c74da-8ef5-4f13-88fc-831b87dce381', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:13 devstack sudo[84485]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15d22e7-736c-400f-bb75-c25b30193e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15d22e7-736c-400f-bb75-c25b30193e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987e80aa-d228-44eb-881f-63e1c07629cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:13 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Volume 333c74da-8ef5-4f13-88fc-831b87dce381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-333c74da-8ef5-4f13-88fc-831b87dce381', 'volume_size': 1} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1479678105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333c74da-8ef5-4f13-88fc-831b87dce381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a22290c438945b39bb98015fafa8857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:13Z,use_quota=True,user_id='c1b7ac7ba1ef4a0a8c0fad5d499e5eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Creating volume 333c74da-8ef5-4f13-88fc-831b87dce381 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:13 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170" returned: 0 in 1.125s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:13 devstack sudo[84490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381 1073741824 Apr 10 10:32:13 devstack sudo[84490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:13 devstack sudo[84491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f Apr 10 10:32:13 devstack sudo[84491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:14 devstack sudo[84490]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381 1073741824" returned: 0 in 0.933s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:14 devstack sudo[84501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381 Apr 10 10:32:14 devstack sudo[84501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:14 devstack sudo[84491]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f" returned: 0 in 1.011s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:14 devstack sudo[84503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f Apr 10 10:32:14 devstack sudo[84503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:15 devstack sudo[84501]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381" returned: 0 in 0.643s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987e80aa-d228-44eb-881f-63e1c07629cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333c74da-8ef5-4f13-88fc-831b87dce381', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e0a714-d277-4de5-b1c0-d396144119f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:15 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Volume volume-333c74da-8ef5-4f13-88fc-831b87dce381 (333c74da-8ef5-4f13-88fc-831b87dce381): created successfully Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e0a714-d277-4de5-b1c0-d396144119f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Flow 'volume_create_manager' (e1953931-a961-4200-8e82-8b3876bfbb7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ed2ca3e1-2d98-42fe-a1e6-c05b86f90cbc tempest-ServersNegativeTestJSON-1087412955 None] Created volume successfully. Apr 10 10:32:15 devstack sudo[84503]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170.ab288b1d-d490-4fcc-a09d-709a7b02187f" returned: 0 in 0.758s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-ab288b1d-d490-4fcc-a09d-709a7b02187f" released by "_delete_snapshot" :: held 4.029s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-68f28349-46af-4e33-8a99-84cbdded0170" released by "delete_snapshot" :: held 4.048s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:15 devstack cinder-volume[83037]: WARNING cinder.quota [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2100630860 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2100630860, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:15 devstack cinder-volume[83037]: WARNING cinder.quota [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2100630860 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2100630860, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['4f663577-c8af-4739-868a-33204188329e', 'cb0cfe15-6b2a-4ce8-8d69-81450ae7accd', '92d84866-b423-493f-b9f6-acf1a3110181', 'ebc28a87-a0f7-4a5a-b475-2ea8af0809fa'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['4e2edca9-20fb-4df1-a834-fd2deb679710', 'a329ef27-816e-48c9-8760-efa14ec90140', 'fa628560-e55a-4138-8f35-e01b79525253', 'f8397d36-b4eb-4501-a03f-dc4fb2c48a97'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-60e6975f-567b-4cfa-ac28-6c1c90f8f29d tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 9d46902f-3370-40d0-9729-6ff8f2149254: deleted successfully Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Acquiring lock "cinder-333c74da-8ef5-4f13-88fc-831b87dce381-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Lock "cinder-333c74da-8ef5-4f13-88fc-831b87dce381-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Acquiring lock "cinder-quobyte-333c74da-8ef5-4f13-88fc-831b87dce381" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Lock "cinder-quobyte-333c74da-8ef5-4f13-88fc-831b87dce381" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dab3b0-128e-491f-b196-f035c474586b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:16 devstack sudo[84510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381 Apr 10 10:32:16 devstack sudo[84510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-61aac9cb-6db7-4361-95e3-f762119f9e65" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-61aac9cb-6db7-4361-95e3-f762119f9e65" acquired by "delete_volume" :: waited 0.036s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:16 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4917d3-481c-4fd5-be0d-fff1aa31c05a]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:16 devstack sudo[84512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 Apr 10 10:32:16 devstack sudo[84512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:16 devstack sudo[84510]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381" returned: 0 in 0.710s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:16 devstack sudo[84518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381 Apr 10 10:32:16 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:17 devstack sudo[84512]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65" returned: 0 in 0.805s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:17 devstack sudo[84524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65 Apr 10 10:32:17 devstack sudo[84524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:17 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-333c74da-8ef5-4f13-88fc-831b87dce381" returned: 0 in 0.716s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Lock "cinder-quobyte-333c74da-8ef5-4f13-88fc-831b87dce381" released by "delete_volume" :: held 1.482s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Created reservations ['2de94269-b243-42c2-98b1-285fd9c9ffe7', 'bedf0557-7619-4426-be9f-719f0f098230', '9851b6b7-99dd-4281-92b6-8ad3aa5a5247', 'f027dacc-81c5-4a0a-be0e-d71799859647'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:17 devstack sudo[84526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:32:17 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:17 devstack sudo[84524]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-61aac9cb-6db7-4361-95e3-f762119f9e65" returned: 0 in 0.598s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-61aac9cb-6db7-4361-95e3-f762119f9e65" released by "delete_volume" :: held 1.466s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-68f28349-46af-4e33-8a99-84cbdded0170" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-68f28349-46af-4e33-8a99-84cbdded0170" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e85b38-a079-4bdf-9f72-12e8db53cf26]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:18 devstack sudo[84529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 Apr 10 10:32:18 devstack sudo[84529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Acquiring lock "cinder-0a57464d-d34a-42ad-bbd9-b35e6c22d221-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Lock "cinder-0a57464d-d34a-42ad-bbd9-b35e6c22d221-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Acquiring lock "cinder-quobyte-0a57464d-d34a-42ad-bbd9-b35e6c22d221" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Lock "cinder-quobyte-0a57464d-d34a-42ad-bbd9-b35e6c22d221" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b868075-d2ec-434b-a239-bafaddc5207b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:18 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.695s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:18 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Deleted volume successfully. Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3500b3a6-411b-4b75-8ce7-30c20c0e0797 tempest-ServersNegativeTestJSON-1087412955 None] Lock "cinder-333c74da-8ef5-4f13-88fc-831b87dce381-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:18 devstack sudo[84532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221 Apr 10 10:32:18 devstack sudo[84532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:18 devstack sudo[84529]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170" returned: 0 in 0.771s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:18 devstack sudo[84538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170 Apr 10 10:32:18 devstack sudo[84538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:18 devstack sudo[84532]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221" returned: 0 in 0.721s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:18 devstack sudo[84542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221 Apr 10 10:32:18 devstack sudo[84542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:19 devstack sudo[84538]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-68f28349-46af-4e33-8a99-84cbdded0170" returned: 0 in 0.613s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-68f28349-46af-4e33-8a99-84cbdded0170" released by "delete_volume" :: held 1.423s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['ce796aee-aed3-4588-b18f-d42e985a1296'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:19 devstack cinder-volume[83037]: WARNING cinder.quota [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2100630860 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2100630860, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['98e4a6a3-2d89-479e-b0a4-feeb19391e93', 'd8107a2c-fa3a-4a45-824b-f283e6f38896', 'a1da379c-f16f-4625-9758-ae57bcad841d', '904df545-ee74-4334-a9d7-0df366fa9ba9'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:19 devstack sudo[84542]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0a57464d-d34a-42ad-bbd9-b35e6c22d221" returned: 0 in 0.665s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Lock "cinder-quobyte-0a57464d-d34a-42ad-bbd9-b35e6c22d221" released by "delete_volume" :: held 1.417s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['d0826d53-a854-4903-bd8b-5c901ab90a1d', 'eafeb9e9-d996-407d-929c-4bc5272cb058', 'a0721df4-43cc-4822-bb87-15f4f31f0938', '072dea6b-4e71-42c5-9c82-ae5c95a278fb'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Created reservations ['c05ade82-97f3-42c2-9ece-aa06b3f29153', '8078ee26-2912-4ee9-8ca5-8f4603c41379', '007011e3-8b1b-4d0d-87b7-0c23b54fb1fe', '7a44c647-0a71-424b-8647-e94df55b0d6e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:19 devstack sudo[84552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:32:19 devstack sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:19 devstack sudo[84554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:32:19 devstack sudo[84554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cbda70b1-b51e-42da-95f5-3ba40d671521 tempest-GroupSnapshotsTest-1126085628 None] Group tempest-GroupSnapshotsTest-Group-711867823: creating Apr 10 10:32:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cbda70b1-b51e-42da-95f5-3ba40d671521 tempest-GroupSnapshotsTest-1126085628 None] Group tempest-GroupSnapshotsTest-Group-711867823: created successfully Apr 10 10:32:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cbda70b1-b51e-42da-95f5-3ba40d671521 tempest-GroupSnapshotsTest-1126085628 None] Create group completed successfully. Apr 10 10:32:20 devstack sudo[84552]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.844s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:20 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:20 devstack sudo[84554]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Deleted volume successfully. Apr 10 10:32:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.802s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:20 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f7981f64-ad64-47e8-9427-09721ab10217 tempest-GroupSnapshotsTest-1126085628 None] Delete group completed successfully. Apr 10 10:32:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d890fd8b-8a23-48f9-a853-40eea119f8b0 tempest-ServersNegativeTestJSON-1087412955 None] Lock "cinder-0a57464d-d34a-42ad-bbd9-b35e6c22d221-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-63c83d36-da74-46c8-9bed-95166e445e6f tempest-BackendsCapabilitiesAdminTestsJSON-1128258180 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83037) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Flow 'volume_create_manager' (0ae46231-9740-41aa-8c06-be7e417601d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32a7e06-82fa-4381-8202-2934a596ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32a7e06-82fa-4381-8202-2934a596ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-653281967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68f1cdf9-efad-4d98-bdb9-2d51bb066a07,host='devstack@QuobyteHD#QuobyteHD',id=49ba91aa-4469-40ef-b28a-01f0950c5a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a177ea49e1146b698720d3523b6ac92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:22Z,use_quota=True,user_id='ffe2330e78ed47889e152ef59e544bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13d78d34-443c-4ee3-baac-82c306604c1b),volume_type_id=13d78d34-443c-4ee3-baac-82c306604c1b)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702b7516-6854-4ff0-a5c8-86d95f481bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702b7516-6854-4ff0-a5c8-86d95f481bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e5c8df-f466-4f48-bcb6-95c35f057b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e5c8df-f466-4f48-bcb6-95c35f057b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ba91aa-4469-40ef-b28a-01f0950c5a2f', 'volume_name': 'volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc8aedd-6783-4a82-8f7e-3f71bfbc5692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc8aedd-6783-4a82-8f7e-3f71bfbc5692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f107298-b93c-41a3-8e6f-5b119b7b4eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:21 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Volume 49ba91aa-4469-40ef-b28a-01f0950c5a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f', 'volume_size': 1} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=68f1cdf9-efad-4d98-bdb9-2d51bb066a07,created_at=2026-04-10T08:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-653281967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=68f1cdf9-efad-4d98-bdb9-2d51bb066a07,host='devstack@QuobyteHD#QuobyteHD',id=49ba91aa-4469-40ef-b28a-01f0950c5a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a177ea49e1146b698720d3523b6ac92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:22Z,use_quota=True,user_id='ffe2330e78ed47889e152ef59e544bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13d78d34-443c-4ee3-baac-82c306604c1b),volume_type_id=13d78d34-443c-4ee3-baac-82c306604c1b)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Creating volume 49ba91aa-4469-40ef-b28a-01f0950c5a2f {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:21 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:32:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:21 devstack sudo[84600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f 1073741824 Apr 10 10:32:21 devstack sudo[84600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-812e50f9-a38b-45b2-8ea0-742d39235deb tempest-BackendsCapabilitiesAdminTestsJSON-1128258180 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83037) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 10:32:22 devstack sudo[84600]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f 1073741824" returned: 0 in 0.836s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:22 devstack sudo[84608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f Apr 10 10:32:22 devstack sudo[84608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:23 devstack sudo[84608]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f" returned: 0 in 0.587s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f107298-b93c-41a3-8e6f-5b119b7b4eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfdf3c0-bc1e-44f8-9bfc-8a2826bcc6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:23 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Volume volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f (49ba91aa-4469-40ef-b28a-01f0950c5a2f): created successfully Apr 10 10:32:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfdf3c0-bc1e-44f8-9bfc-8a2826bcc6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Flow 'volume_create_manager' (0ae46231-9740-41aa-8c06-be7e417601d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-35920618-2614-471f-b93e-e063601f2da9 tempest-GroupSnapshotsTest-1126085628 None] Created volume successfully. Apr 10 10:32:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] GroupSnapshot 0f169e97-1d08-4fa0-8602-04f359f320fc: creating. Apr 10 10:32:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] Group snapshot 0f169e97-1d08-4fa0-8602-04f359f320fc: creating. {{(pid=83037) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:32:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] Creating offline snapshot 72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 of volume 49ba91aa-4469-40ef-b28a-01f0950c5a2f {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:32:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3557818-8e13-4ac6-a452-a96ce699b27b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:24 devstack sudo[84612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f Apr 10 10:32:24 devstack sudo[84612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:24 devstack sudo[84612]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f" returned: 0 in 0.739s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:24 devstack sudo[84620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 1G Apr 10 10:32:24 devstack sudo[84620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:25 devstack sudo[84620]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 1G" returned: 0 in 0.679s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:25 devstack sudo[84625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 Apr 10 10:32:25 devstack sudo[84625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:26 devstack sudo[84625]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8" returned: 0 in 0.563s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:26 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:32:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:26 devstack sudo[84630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 Apr 10 10:32:26 devstack sudo[84630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:27 devstack sudo[84630]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8" returned: 0 in 0.980s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:27 devstack sudo[84658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.info Apr 10 10:32:27 devstack sudo[84658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:28 devstack sudo[84658]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.info" returned: 0 in 1.039s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:28 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:32:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:28 devstack sudo[84696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.info Apr 10 10:32:28 devstack sudo[84696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:29 devstack sudo[84696]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.info" returned: 0 in 0.832s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.927s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9b660d3d-e690-470f-a10f-ba7a787e095f tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 0f169e97-1d08-4fa0-8602-04f359f320fc: created successfully Apr 10 10:32:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 0f169e97-1d08-4fa0-8602-04f359f320fc: deleting Apr 10 10:32:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 0f169e97-1d08-4fa0-8602-04f359f320fc: deleting {{(pid=83037) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:32:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-49ba91aa-4469-40ef-b28a-01f0950c5a2f" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-49ba91aa-4469-40ef-b28a-01f0950c5a2f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-72e1f5a3-3d18-4abe-9b2e-c8a126f970b8" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-72e1f5a3-3d18-4abe-9b2e-c8a126f970b8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Deleting offline snapshot 72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 of volume 49ba91aa-4469-40ef-b28a-01f0950c5a2f {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:32:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] snapshot_file for this snap is: volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:32:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f469fb2f-14e2-449b-bce0-9817df046626]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:29 devstack sudo[84699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 Apr 10 10:32:29 devstack sudo[84699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Flow 'volume_create_manager' (51f0210a-358c-4225-a1a0-db557666c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a67219-06f7-4874-a785-fea6062de8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a67219-06f7-4874-a785-fea6062de8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-560352563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cfe12b-3233-44d3-9b71-0ded09433971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296799e0f223436690f509512d454b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:30Z,use_quota=True,user_id='ded3ae123cf74aaa902293b4ffb94d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdec6e5-a00f-4139-b561-6376446ceefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbdec6e5-a00f-4139-b561-6376446ceefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7869cccc-9033-4d5e-8910-8461214c4359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7869cccc-9033-4d5e-8910-8461214c4359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5cfe12b-3233-44d3-9b71-0ded09433971', 'volume_name': 'volume-b5cfe12b-3233-44d3-9b71-0ded09433971', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b2c6ae-2cb7-4bc3-9fb3-1cdd9dbd5c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b2c6ae-2cb7-4bc3-9fb3-1cdd9dbd5c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0cc131-1f18-46fc-8dd9-31c951a42d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:30 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Volume b5cfe12b-3233-44d3-9b71-0ded09433971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5cfe12b-3233-44d3-9b71-0ded09433971', 'volume_size': 1} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-560352563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cfe12b-3233-44d3-9b71-0ded09433971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296799e0f223436690f509512d454b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:30Z,use_quota=True,user_id='ded3ae123cf74aaa902293b4ffb94d23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Creating volume b5cfe12b-3233-44d3-9b71-0ded09433971 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:30 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:30 devstack sudo[84702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971 1073741824 Apr 10 10:32:30 devstack sudo[84702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:30 devstack sudo[84699]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8" returned: 0 in 0.990s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d078991-b367-47c2-b640-ebcdc4bbbd66]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:30 devstack sudo[84707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f Apr 10 10:32:30 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:31 devstack sudo[84702]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971 1073741824" returned: 0 in 0.919s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:31 devstack sudo[84712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971 Apr 10 10:32:31 devstack sudo[84712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:31 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f" returned: 0 in 1.026s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:31 devstack sudo[84717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 Apr 10 10:32:31 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:32 devstack sudo[84712]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971" returned: 0 in 0.829s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0cc131-1f18-46fc-8dd9-31c951a42d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5cfe12b-3233-44d3-9b71-0ded09433971', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0722c1-6f12-4e2d-9950-da90bf5050bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:32 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Volume volume-b5cfe12b-3233-44d3-9b71-0ded09433971 (b5cfe12b-3233-44d3-9b71-0ded09433971): created successfully Apr 10 10:32:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0722c1-6f12-4e2d-9950-da90bf5050bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Flow 'volume_create_manager' (51f0210a-358c-4225-a1a0-db557666c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cbc5e45a-f3d8-410d-9546-fba8488a8482 tempest-DeleteServersTestJSON-2055864585 None] Created volume successfully. Apr 10 10:32:32 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8" returned: 0 in 0.949s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:32 devstack sudo[84724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8 Apr 10 10:32:32 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:33 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f.72e1f5a3-3d18-4abe-9b2e-c8a126f970b8" returned: 0 in 0.765s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-72e1f5a3-3d18-4abe-9b2e-c8a126f970b8" released by "_delete_snapshot" :: held 3.848s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-49ba91aa-4469-40ef-b28a-01f0950c5a2f" released by "delete_snapshot" :: held 3.866s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:33 devstack cinder-volume[83037]: WARNING cinder.quota [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1597894285 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1597894285, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:33 devstack cinder-volume[83037]: WARNING cinder.quota [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1597894285 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1597894285, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:33 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['335b6d50-0945-41ce-bb15-939d9b19d958', 'f39293ee-7cef-46c8-8f55-43c7fd6b6d85', '332e2e70-7575-4038-a9f5-a2a385036b54', '80d9b9f8-1d57-4202-bacd-82b282e4b6e8'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-54c0b084-6ba4-4d5b-aa90-af9befaef5c8 tempest-GroupSnapshotsTest-1126085628 None] group_snapshot 0f169e97-1d08-4fa0-8602-04f359f320fc: deleted successfully Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "cinder-quobyte-49ba91aa-4469-40ef-b28a-01f0950c5a2f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-49ba91aa-4469-40ef-b28a-01f0950c5a2f" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a09ac2c-01a2-4a2e-a9ab-1ae73b4931b7]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:34 devstack sudo[84728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f Apr 10 10:32:34 devstack sudo[84728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Flow 'volume_create_manager' (c7002132-08a4-45ee-ba6c-999fcb340625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6e27b2-440f-4b09-8a1a-72ba90e5c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6e27b2-440f-4b09-8a1a-72ba90e5c860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-258906694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4266e52-5a15-41f0-95b4-060ff6d70a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd443ac54f50481199ead28d89aa4fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:35Z,use_quota=True,user_id='21255ce0deee4f379f7b1ddb5770ff85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fadfc8-de67-4548-9ee1-f229a7ef02f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fadfc8-de67-4548-9ee1-f229a7ef02f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec396a5e-4161-43a7-8ad6-72acea84e674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec396a5e-4161-43a7-8ad6-72acea84e674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4266e52-5a15-41f0-95b4-060ff6d70a53', 'volume_name': 'volume-c4266e52-5a15-41f0-95b4-060ff6d70a53', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faabbfa6-d0e9-41dc-8c99-cf67464a4023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faabbfa6-d0e9-41dc-8c99-cf67464a4023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747344a6-2630-4c5c-91c8-7dde678774a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:34 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Volume c4266e52-5a15-41f0-95b4-060ff6d70a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4266e52-5a15-41f0-95b4-060ff6d70a53', 'volume_size': 1} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-258906694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4266e52-5a15-41f0-95b4-060ff6d70a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd443ac54f50481199ead28d89aa4fff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:35Z,use_quota=True,user_id='21255ce0deee4f379f7b1ddb5770ff85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Creating volume c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:35 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:32:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:35 devstack sudo[84730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 1073741824 Apr 10 10:32:35 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:35 devstack sudo[84728]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f" returned: 0 in 0.853s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:35 devstack sudo[84735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f Apr 10 10:32:35 devstack sudo[84735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:36 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 1073741824" returned: 0 in 1.107s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:36 devstack sudo[84744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 Apr 10 10:32:36 devstack sudo[84744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:36 devstack sudo[84735]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Flow 'volume_create_manager' (63ad7b24-4494-4604-87db-c85fc696dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee658e9d-3c64-48c8-bff8-a55f350c7d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49ba91aa-4469-40ef-b28a-01f0950c5a2f" returned: 0 in 1.062s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee658e9d-3c64-48c8-bff8-a55f350c7d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-999949849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dc2518-78a5-4d9d-b7d9-26453e301e94,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1a1b7389f9fb4c638261b1ba18776432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:36Z,use_quota=True,user_id='8affdea55a944b55b892f128ce4b0e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4beb06-c4bf-4cd9-bfe6-63ef04c6784c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4beb06-c4bf-4cd9-bfe6-63ef04c6784c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cbb507-2cd9-44be-8426-73e7bb414a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cbb507-2cd9-44be-8426-73e7bb414a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9dc2518-78a5-4d9d-b7d9-26453e301e94', 'volume_name': 'volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38de353-ced3-4e98-89c9-f112c5857ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38de353-ced3-4e98-89c9-f112c5857ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1116e4-1343-48ce-991b-4e98586952e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:36 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Volume b9dc2518-78a5-4d9d-b7d9-26453e301e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94', 'volume_size': 1} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Lock "cinder-quobyte-49ba91aa-4469-40ef-b28a-01f0950c5a2f" released by "delete_volume" :: held 2.072s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['3c5663b0-2d83-48a3-89f4-1e17688ae64b'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:36 devstack cinder-volume[83037]: WARNING cinder.quota [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1597894285 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1597894285, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Created reservations ['03e176a6-2fa6-46dd-8443-8f692318c1c3', '53b0a517-0501-4794-a7b8-ceaf54179dee', '22373887-93a7-4d36-a55b-ebcabff304fb', '8def0b08-d1cc-42e6-b9f5-4f7e70756ee2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:36 devstack sudo[84747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:32:36 devstack sudo[84747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:36 devstack sudo[84744]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53" returned: 0 in 0.725s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.484s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-999949849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dc2518-78a5-4d9d-b7d9-26453e301e94,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1a1b7389f9fb4c638261b1ba18776432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:36Z,use_quota=True,user_id='8affdea55a944b55b892f128ce4b0e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Creating volume b9dc2518-78a5-4d9d-b7d9-26453e301e94 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:36 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:36 devstack sudo[84751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94 1073741824 Apr 10 10:32:36 devstack sudo[84751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747344a6-2630-4c5c-91c8-7dde678774a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4266e52-5a15-41f0-95b4-060ff6d70a53', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4d80b8-9b55-41e8-9bf3-1484c925e693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:37 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Volume volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 (c4266e52-5a15-41f0-95b4-060ff6d70a53): created successfully Apr 10 10:32:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4d80b8-9b55-41e8-9bf3-1484c925e693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Flow 'volume_create_manager' (c7002132-08a4-45ee-ba6c-999fcb340625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-faebe68d-1e14-431b-87de-b51adc687d63 tempest-SnapshotsActionsTest-235934814 None] Created volume successfully. Apr 10 10:32:37 devstack cinder-volume[83037]: WARNING py.warnings [req-b8c4fb40-18f4-4416-939f-5ab44bd1fc5a req-6f6c35f7-fc84-4858-9d0f-d1898916ab99 tempest-DeleteServersTestJSON-2055864585 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 10 10:32:37 devstack cinder-volume[83037]: .first() Apr 10 10:32:37 devstack cinder-volume[83037]: Apr 10 10:32:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-b8c4fb40-18f4-4416-939f-5ab44bd1fc5a req-6f6c35f7-fc84-4858-9d0f-d1898916ab99 tempest-DeleteServersTestJSON-2055864585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:37 devstack sudo[84747]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.643s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:37 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-98abc664-08f9-421a-ac2b-9f4c776add96 tempest-GroupSnapshotsTest-1126085628 None] Delete group completed successfully. Apr 10 10:32:37 devstack sudo[84751]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94 1073741824" returned: 0 in 0.684s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:37 devstack sudo[84765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94 Apr 10 10:32:37 devstack sudo[84765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:38 devstack sudo[84765]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94" returned: 0 in 0.636s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-b8c4fb40-18f4-4416-939f-5ab44bd1fc5a req-6f6c35f7-fc84-4858-9d0f-d1898916ab99 tempest-DeleteServersTestJSON-2055864585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.041s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1116e4-1343-48ce-991b-4e98586952e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d942aec0-84d9-4d9d-bbaf-a2ff7696cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:38 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71f4b77-e8c4-4b96-9b47-2e048cfa4ee3]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-b8c4fb40-18f4-4416-939f-5ab44bd1fc5a req-6f6c35f7-fc84-4858-9d0f-d1898916ab99 tempest-DeleteServersTestJSON-2055864585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:38 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Volume volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94 (b9dc2518-78a5-4d9d-b7d9-26453e301e94): created successfully Apr 10 10:32:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d942aec0-84d9-4d9d-bbaf-a2ff7696cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Flow 'volume_create_manager' (63ad7b24-4494-4604-87db-c85fc696dae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-02bd962b-9960-4efd-9813-9b29049e9d9d tempest-VolumesTestJSON-284863680 None] Created volume successfully. Apr 10 10:32:38 devstack sudo[84768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971 Apr 10 10:32:38 devstack sudo[84768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Flow 'volume_create_manager' (6d986c67-682f-4ef1-b658-f24ac5680470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d37951-993d-4807-8a61-551878682538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d37951-993d-4807-8a61-551878682538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-308651775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a868b2-997d-4aab-b19a-a6d103244663,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1a1b7389f9fb4c638261b1ba18776432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:39Z,use_quota=True,user_id='8affdea55a944b55b892f128ce4b0e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15ec8ee-4b96-492c-b40e-0e37c1f20902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15ec8ee-4b96-492c-b40e-0e37c1f20902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69641a1c-1dae-4f78-aebc-a6e1ca8a33bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69641a1c-1dae-4f78-aebc-a6e1ca8a33bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a868b2-997d-4aab-b19a-a6d103244663', 'volume_name': 'volume-b5a868b2-997d-4aab-b19a-a6d103244663', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d5d654-adc9-42f0-b607-b65324bae9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d5d654-adc9-42f0-b607-b65324bae9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95f524e-9d1a-4495-9d35-a94c4b52c906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Volume b5a868b2-997d-4aab-b19a-a6d103244663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a868b2-997d-4aab-b19a-a6d103244663', 'volume_size': 1} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:39 devstack sudo[84768]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-b8c4fb40-18f4-4416-939f-5ab44bd1fc5a req-6f6c35f7-fc84-4858-9d0f-d1898916ab99 tempest-DeleteServersTestJSON-2055864585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971" returned: 0 in 0.888s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-b8c4fb40-18f4-4416-939f-5ab44bd1fc5a req-6f6c35f7-fc84-4858-9d0f-d1898916ab99 tempest-DeleteServersTestJSON-2055864585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.936s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.713s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] Creating offline snapshot 0b99a8e5-be56-48c9-8964-8d9ce895e103 of volume c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[be381c43-695a-4159-8129-d6b60dfeba6a]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-b8c4fb40-18f4-4416-939f-5ab44bd1fc5a req-6f6c35f7-fc84-4858-9d0f-d1898916ab99 tempest-DeleteServersTestJSON-2055864585 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac', 'name': 'volume-b5cfe12b-3233-44d3-9b71-0ded09433971', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b5fa406-57cf-432e-8b8d-37c59742b219', 'enforce_multipath': True} {{(pid=83037) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 10:32:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-b8c4fb40-18f4-4416-939f-5ab44bd1fc5a req-6f6c35f7-fc84-4858-9d0f-d1898916ab99 tempest-DeleteServersTestJSON-2055864585 None] attachment_update completed successfully. Apr 10 10:32:39 devstack sudo[84773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 Apr 10 10:32:39 devstack sudo[84773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:40 devstack sudo[84773]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53" returned: 0 in 0.760s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:40 devstack sudo[84780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 1G Apr 10 10:32:40 devstack sudo[84780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:40 devstack sudo[84780]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 1G" returned: 0 in 0.822s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:40 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:32:40 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:41 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.660s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:41 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 is being set with open permissions: ugo+rw Apr 10 10:32:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:41 devstack sudo[85173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:32:41 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:42 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.537s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:42 devstack sudo[85177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.info Apr 10 10:32:42 devstack sudo[85177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:42 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-34575db8-d041-4ef8-9fba-ed441ecf8427 tempest-GroupSnapshotsV319Test-792895560 None] Group tempest-GroupSnapshotsV319Test-Group-1716437905: creating Apr 10 10:32:42 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-34575db8-d041-4ef8-9fba-ed441ecf8427 tempest-GroupSnapshotsV319Test-792895560 None] Group tempest-GroupSnapshotsV319Test-Group-1716437905: created successfully Apr 10 10:32:42 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-34575db8-d041-4ef8-9fba-ed441ecf8427 tempest-GroupSnapshotsV319Test-792895560 None] Create group completed successfully. Apr 10 10:32:42 devstack sudo[85177]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.info" returned: 0 in 0.561s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:42 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.info is being set with open permissions: ugo+rw Apr 10 10:32:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:42 devstack sudo[85180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.info Apr 10 10:32:42 devstack sudo[85180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:43 devstack sudo[85180]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.info" returned: 0 in 0.526s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.985s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.015s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-308651775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a868b2-997d-4aab-b19a-a6d103244663,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1a1b7389f9fb4c638261b1ba18776432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:39Z,use_quota=True,user_id='8affdea55a944b55b892f128ce4b0e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Creating volume b5a868b2-997d-4aab-b19a-a6d103244663 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:43 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:32:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:43 devstack sudo[85183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663 1073741824 Apr 10 10:32:43 devstack sudo[85183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-eb54f4b4-a2ca-47a6-a0e5-5f1d3cada90f tempest-SnapshotsActionsTest-235934814 None] Create snapshot completed successfully Apr 10 10:32:44 devstack sudo[85183]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663 1073741824" returned: 0 in 0.867s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Flow 'volume_create_manager' (b168583d-62ac-4a55-8a3b-c490985c83b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e40bc4-f28e-4e6d-8d0f-373c1457d5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e40bc4-f28e-4e6d-8d0f-373c1457d5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1020452184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8085f90b-cdf5-4f09-81ab-24b010f8aaad,host='devstack@QuobyteHD#QuobyteHD',id=a4358ae5-a251-4449-b676-851b8c5f1106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ce8180e36b441d8fefdf224bea26c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:44Z,use_quota=True,user_id='cf183870740b482db1ea0441b670e8a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccbe0692-768a-49d2-bae3-384586128ffd),volume_type_id=ccbe0692-768a-49d2-bae3-384586128ffd)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28c1b76-14a5-4496-b4cb-1844ba2e8c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28c1b76-14a5-4496-b4cb-1844ba2e8c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781a7853-8d80-443d-9511-c21d71091a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781a7853-8d80-443d-9511-c21d71091a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4358ae5-a251-4449-b676-851b8c5f1106', 'volume_name': 'volume-a4358ae5-a251-4449-b676-851b8c5f1106', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0454e28e-64ef-451a-8eeb-f4f6d521451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0454e28e-64ef-451a-8eeb-f4f6d521451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dda10bf-1580-4900-ad74-dc4aa219c383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Volume a4358ae5-a251-4449-b676-851b8c5f1106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4358ae5-a251-4449-b676-851b8c5f1106', 'volume_size': 1} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:44 devstack sudo[85188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663 Apr 10 10:32:44 devstack sudo[85188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:44 devstack sudo[85188]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663" returned: 0 in 0.630s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8085f90b-cdf5-4f09-81ab-24b010f8aaad,created_at=2026-04-10T08:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1020452184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8085f90b-cdf5-4f09-81ab-24b010f8aaad,host='devstack@QuobyteHD#QuobyteHD',id=a4358ae5-a251-4449-b676-851b8c5f1106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ce8180e36b441d8fefdf224bea26c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:44Z,use_quota=True,user_id='cf183870740b482db1ea0441b670e8a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccbe0692-768a-49d2-bae3-384586128ffd),volume_type_id=ccbe0692-768a-49d2-bae3-384586128ffd)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Creating volume a4358ae5-a251-4449-b676-851b8c5f1106 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:44 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:44 devstack sudo[85191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 1073741824 Apr 10 10:32:44 devstack sudo[85191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95f524e-9d1a-4495-9d35-a94c4b52c906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a868b2-997d-4aab-b19a-a6d103244663', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759c7349-13f4-4080-b61b-a8511a142fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Volume volume-b5a868b2-997d-4aab-b19a-a6d103244663 (b5a868b2-997d-4aab-b19a-a6d103244663): created successfully Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759c7349-13f4-4080-b61b-a8511a142fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Flow 'volume_create_manager' (6d986c67-682f-4ef1-b658-f24ac5680470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-dcfa5925-95b6-4ce6-b26a-19f7d00cf788 tempest-VolumesTestJSON-284863680 None] Created volume successfully. Apr 10 10:32:45 devstack sudo[85191]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 1073741824" returned: 0 in 0.569s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:45 devstack sudo[85204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 Apr 10 10:32:45 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Flow 'volume_create_manager' (88fdfa8c-fb24-486a-a7bc-e2f992c549d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:46 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137feafb-f6e8-416a-857d-db8ee65b5421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137feafb-f6e8-416a-857d-db8ee65b5421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1466056381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e4da15-a8c0-405c-8487-7dcd8f40e303,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1a1b7389f9fb4c638261b1ba18776432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:46Z,use_quota=True,user_id='8affdea55a944b55b892f128ce4b0e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af28cc5f-b65e-46b0-b436-0d5d3eebbfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af28cc5f-b65e-46b0-b436-0d5d3eebbfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e2e2aa-6b8d-454f-9bbe-4432b0a50716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e2e2aa-6b8d-454f-9bbe-4432b0a50716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e4da15-a8c0-405c-8487-7dcd8f40e303', 'volume_name': 'volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbb9eaf-d669-4e0b-8e4c-846b6231c9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbb9eaf-d669-4e0b-8e4c-846b6231c9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a248c4-a8f4-4e5c-a98a-7fd0981bee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Volume c0e4da15-a8c0-405c-8487-7dcd8f40e303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303', 'volume_size': 1} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106" returned: 0 in 0.637s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.598s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] Creating offline snapshot c3e2cf4f-af5a-4da2-bb83-28eac6a3274a of volume c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dda10bf-1580-4900-ad74-dc4aa219c383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4358ae5-a251-4449-b676-851b8c5f1106', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daa34d2-fc55-461d-8aa6-926076139d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ef7181-97ca-4dde-870d-97537be27d13]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Volume volume-a4358ae5-a251-4449-b676-851b8c5f1106 (a4358ae5-a251-4449-b676-851b8c5f1106): created successfully Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7daa34d2-fc55-461d-8aa6-926076139d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Flow 'volume_create_manager' (b168583d-62ac-4a55-8a3b-c490985c83b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-624adaac-1bf0-4664-ae58-a79eb2eee244 tempest-GroupSnapshotsV319Test-792895560 None] Created volume successfully. Apr 10 10:32:46 devstack sudo[85225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:32:46 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] GroupSnapshot 62ada887-228f-427c-ba0a-8dd423d8f586: creating. Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] Group snapshot 62ada887-228f-427c-ba0a-8dd423d8f586: creating. {{(pid=83037) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:46 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.561s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:32:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:46 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a 1G Apr 10 10:32:46 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:47 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a 1G" returned: 0 in 0.689s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:47 devstack sudo[85261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a Apr 10 10:32:47 devstack sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:48 devstack sudo[85261]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a" returned: 0 in 0.570s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:48 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a is being set with open permissions: ugo+rw Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:48 devstack sudo[85266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a Apr 10 10:32:48 devstack sudo[85266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-976a21ab-4834-4ad3-b9a4-f9d95f463b14 req-ed273e1f-f6d7-4d77-a280-a206102372ec tempest-DeleteServersTestJSON-2055864585 None] Terminate volume connection completed successfully. Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-976a21ab-4834-4ad3-b9a4-f9d95f463b14 req-ed273e1f-f6d7-4d77-a280-a206102372ec tempest-DeleteServersTestJSON-2055864585 None] Deleting attachment 3b5fa406-57cf-432e-8b8d-37c59742b219. {{(pid=83037) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 10:32:48 devstack sudo[85266]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a" returned: 0 in 0.566s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.477s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1466056381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e4da15-a8c0-405c-8487-7dcd8f40e303,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1a1b7389f9fb4c638261b1ba18776432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:46Z,use_quota=True,user_id='8affdea55a944b55b892f128ce4b0e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Creating volume c0e4da15-a8c0-405c-8487-7dcd8f40e303 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:48 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:32:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:48 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303 1073741824 Apr 10 10:32:48 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-20dd2456-1d1c-4908-a3be-73da6b715550 tempest-SnapshotsActionsTest-235934814 None] Create snapshot completed successfully Apr 10 10:32:49 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303 1073741824" returned: 0 in 0.762s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=118,cinder:UPDATE=99,cinder:INSERT=28,cinder:DELETE=7 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=106,cinder:UPDATE=125,cinder:INSERT=22,cinder:DELETE=6 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:49 devstack sudo[85275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303 Apr 10 10:32:49 devstack sudo[85275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-c3e2cf4f-af5a-4da2-bb83-28eac6a3274a-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-c3e2cf4f-af5a-4da2-bb83-28eac6a3274a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-quobyte-c3e2cf4f-af5a-4da2-bb83-28eac6a3274a" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-c3e2cf4f-af5a-4da2-bb83-28eac6a3274a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Deleting offline snapshot c3e2cf4f-af5a-4da2-bb83-28eac6a3274a of volume c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] snapshot_file for this snap is: volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d0089-b367-4675-8817-c68f0f3770c1]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:50 devstack sudo[85275]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303" returned: 0 in 0.603s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:50 devstack sudo[85278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a Apr 10 10:32:50 devstack sudo[85278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.510s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] Creating offline snapshot ac1fe1d3-7656-4564-956e-cddef29b334a of volume a4358ae5-a251-4449-b676-851b8c5f1106 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a248c4-a8f4-4e5c-a98a-7fd0981bee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a349646-653b-4132-9242-1fc3f7c9432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd97a4c8-cf6f-4729-9828-7741fc0f88a6]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Volume volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303 (c0e4da15-a8c0-405c-8487-7dcd8f40e303): created successfully Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a349646-653b-4132-9242-1fc3f7c9432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Flow 'volume_create_manager' (88fdfa8c-fb24-486a-a7bc-e2f992c549d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ec3dd9bf-76fd-4f0e-a4b3-7903e984885e tempest-VolumesTestJSON-284863680 None] Created volume successfully. Apr 10 10:32:50 devstack sudo[85280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 Apr 10 10:32:50 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:50 devstack sudo[85278]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a" returned: 0 in 0.736s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae94f30-848c-43bb-aa90-044afbfa9338]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:50 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:32:50 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:50 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106" returned: 0 in 0.738s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:50 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a 1G Apr 10 10:32:50 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Acquiring lock "cinder-c0e4da15-a8c0-405c-8487-7dcd8f40e303-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Lock "cinder-c0e4da15-a8c0-405c-8487-7dcd8f40e303-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Acquiring lock "cinder-quobyte-c0e4da15-a8c0-405c-8487-7dcd8f40e303" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Lock "cinder-quobyte-c0e4da15-a8c0-405c-8487-7dcd8f40e303" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:51 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[359eab1b-a9b7-4924-a8dc-aac4c443994b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:51 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.755s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:32:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:51 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303 Apr 10 10:32:51 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:51 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a Apr 10 10:32:51 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:51 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a 1G" returned: 0 in 0.675s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4358ae5-a251-4449-b676-851b8c5f1106 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:51 devstack sudo[85302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4358ae5-a251-4449-b676-851b8c5f1106 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a Apr 10 10:32:51 devstack sudo[85302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Acquiring lock "cinder-b5cfe12b-3233-44d3-9b71-0ded09433971-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Lock "cinder-b5cfe12b-3233-44d3-9b71-0ded09433971-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:52 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303" returned: 0 in 0.764s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:52 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a" returned: 0 in 0.669s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:52 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303 Apr 10 10:32:52 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Acquiring lock "cinder-quobyte-b5cfe12b-3233-44d3-9b71-0ded09433971" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:52 devstack sudo[85315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a Apr 10 10:32:52 devstack sudo[85315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Lock "cinder-quobyte-b5cfe12b-3233-44d3-9b71-0ded09433971" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:52 devstack sudo[85302]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4358ae5-a251-4449-b676-851b8c5f1106 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a" returned: 0 in 0.659s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:52 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6dc226-6a89-40b0-aae7-42d14bffc1d7]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:52 devstack sudo[85318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a Apr 10 10:32:52 devstack sudo[85318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:52 devstack sudo[85319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971 Apr 10 10:32:52 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:52 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0e4da15-a8c0-405c-8487-7dcd8f40e303" returned: 0 in 0.543s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Lock "cinder-quobyte-c0e4da15-a8c0-405c-8487-7dcd8f40e303" released by "delete_volume" :: held 1.343s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Created reservations ['96b5944b-2153-42b8-b0a9-b9f321540c49', '0a9500e9-6905-4f59-9b14-7d96217aeaa4', '795459d7-ba72-405d-b4a7-81adeb0d327c', 'cf3fdd18-9fc0-43ef-a65e-9194765d4f99'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:52 devstack sudo[85315]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.c3e2cf4f-af5a-4da2-bb83-28eac6a3274a" returned: 0 in 0.604s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-c3e2cf4f-af5a-4da2-bb83-28eac6a3274a" released by "_delete_snapshot" :: held 2.857s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" released by "delete_snapshot" :: held 2.881s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:52 devstack cinder-volume[83037]: WARNING cinder.quota [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Created reservations ['44083ecc-4d64-4481-b7f8-cdd23acb0ed0', '0594076d-8f50-46d5-ad81-42dd1d9e2d60', 'bc2dac7b-bf79-4506-ad43-a3f9a42597d1', '8e82523b-2fd2-4609-91d6-07e791ef9dac'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:52 devstack sudo[85318]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a" returned: 0 in 0.688s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:52 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971" returned: 0 in 0.737s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:52 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:32:52 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:52 devstack sudo[85330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971 Apr 10 10:32:52 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Delete snapshot completed successfully. Apr 10 10:32:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-835363c3-95d2-4a9f-ba97-0ef36b7a3c71 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-c3e2cf4f-af5a-4da2-bb83-28eac6a3274a-delete_snapshot" released by "delete_snapshot" :: held 3.078s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:52 devstack sudo[85332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.info Apr 10 10:32:52 devstack sudo[85332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Acquiring lock "cinder-b5a868b2-997d-4aab-b19a-a6d103244663-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Lock "cinder-b5a868b2-997d-4aab-b19a-a6d103244663-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:53 devstack sudo[85332]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.info" returned: 0 in 0.576s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:53 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:53 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Acquiring lock "cinder-quobyte-b5a868b2-997d-4aab-b19a-a6d103244663" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5cfe12b-3233-44d3-9b71-0ded09433971" returned: 0 in 0.624s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:53 devstack sudo[85339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.info Apr 10 10:32:53 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:53 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Lock "cinder-quobyte-b5cfe12b-3233-44d3-9b71-0ded09433971" released by "delete_volume" :: held 1.412s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Lock "cinder-quobyte-b5a868b2-997d-4aab-b19a-a6d103244663" acquired by "delete_volume" :: waited 0.035s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.681s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Deleted volume successfully. Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf67e3d7-36d0-4020-ae4e-94b5895b1946]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a8fe6eb9-07a0-4f6b-8dca-e12dbe25e1f3 tempest-VolumesTestJSON-284863680 None] Lock "cinder-c0e4da15-a8c0-405c-8487-7dcd8f40e303-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Created reservations ['b66b2f8b-9de1-427c-91fd-5c8f05a3e8b9', 'f36322b7-571c-4743-87f8-ca657cadfddc', 'd8d9c11a-0277-4137-9c8a-33f0b4bb2f40', 'eae957fb-5e9a-4825-934e-35bfb58bc7b2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:53 devstack sudo[85341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663 Apr 10 10:32:53 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:53 devstack sudo[85343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:32:53 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:54 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.info" returned: 0 in 0.571s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.040s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.753s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] Creating offline snapshot 9c038bdc-bbd6-4980-afcd-ade96198aec1 of volume c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[57498750-7b87-4f9e-87b1-1a7522d7b219]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2416e2f6-114b-49f5-8825-4fad58b98d12 tempest-GroupSnapshotsV319Test-792895560 None] group_snapshot 62ada887-228f-427c-ba0a-8dd423d8f586: created successfully Apr 10 10:32:54 devstack sudo[85350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:32:54 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:54 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663" returned: 0 in 0.711s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:54 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.613s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Deleted volume successfully. Apr 10 10:32:54 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663 Apr 10 10:32:54 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-482b989c-028c-47cc-bc2d-24491658a767 tempest-DeleteServersTestJSON-2055864585 None] Lock "cinder-b5cfe12b-3233-44d3-9b71-0ded09433971-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:54 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.589s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:54 devstack sudo[85357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 1G Apr 10 10:32:54 devstack sudo[85357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:54 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b5a868b2-997d-4aab-b19a-a6d103244663" returned: 0 in 0.593s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Lock "cinder-quobyte-b5a868b2-997d-4aab-b19a-a6d103244663" released by "delete_volume" :: held 1.354s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:54 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Created reservations ['75673e4d-7a1c-4177-989f-73f8c5f5ffc3', '1e3e4e74-f848-49a1-a4db-fe5f7b11e0ea', 'eb35a127-b8a3-4238-a8c4-177a9b43f9f8', '8134802a-53df-441a-a70b-6999f79f563a'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:55 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:32:55 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] group_snapshot 62ada887-228f-427c-ba0a-8dd423d8f586: deleting Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] group_snapshot 62ada887-228f-427c-ba0a-8dd423d8f586: deleting {{(pid=83037) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Acquiring lock "cinder-quobyte-a4358ae5-a251-4449-b676-851b8c5f1106" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Lock "cinder-quobyte-a4358ae5-a251-4449-b676-851b8c5f1106" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Acquiring lock "cinder-quobyte-ac1fe1d3-7656-4564-956e-cddef29b334a" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Lock "cinder-quobyte-ac1fe1d3-7656-4564-956e-cddef29b334a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Deleting offline snapshot ac1fe1d3-7656-4564-956e-cddef29b334a of volume a4358ae5-a251-4449-b676-851b8c5f1106 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] snapshot_file for this snap is: volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7079d0f-1bab-4b42-9af1-d562eb48f828]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:55 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a Apr 10 10:32:55 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:55 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.585s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Deleted volume successfully. Apr 10 10:32:55 devstack sudo[85357]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d1957427-db20-4124-ac61-7ae3f0f0558c tempest-VolumesTestJSON-284863680 None] Lock "cinder-b5a868b2-997d-4aab-b19a-a6d103244663-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 1G" returned: 0 in 0.947s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:55 devstack sudo[85368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 Apr 10 10:32:55 devstack sudo[85368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Acquiring lock "cinder-b9dc2518-78a5-4d9d-b7d9-26453e301e94-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Lock "cinder-b9dc2518-78a5-4d9d-b7d9-26453e301e94-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Acquiring lock "cinder-quobyte-b9dc2518-78a5-4d9d-b7d9-26453e301e94" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Lock "cinder-quobyte-b9dc2518-78a5-4d9d-b7d9-26453e301e94" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[57503df3-652a-4555-9189-9f01d9cf3e7a]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:55 devstack sudo[85370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94 Apr 10 10:32:55 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:56 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a" returned: 0 in 0.735s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4358ae5-a251-4449-b676-851b8c5f1106(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:32:56 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[be23b934-7fea-4050-b453-17ae1c4edbe6]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:56 devstack sudo[85376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 Apr 10 10:32:56 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:56 devstack sudo[85368]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1" returned: 0 in 0.781s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:56 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 is being set with open permissions: ugo+rw Apr 10 10:32:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:56 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94" returned: 0 in 0.648s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:56 devstack sudo[85384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 Apr 10 10:32:56 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:56 devstack sudo[85386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94 Apr 10 10:32:56 devstack sudo[85386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:57 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106" returned: 0 in 0.839s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:57 devstack sudo[85392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a Apr 10 10:32:57 devstack sudo[85392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:57 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1" returned: 0 in 0.647s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.063s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:57 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bb6c278f-ea4a-4a3f-a8ee-0928cb6f57bc tempest-SnapshotsActionsTest-235934814 None] Create snapshot completed successfully Apr 10 10:32:57 devstack sudo[85386]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b9dc2518-78a5-4d9d-b7d9-26453e301e94" returned: 0 in 0.772s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Lock "cinder-quobyte-b9dc2518-78a5-4d9d-b7d9-26453e301e94" released by "delete_volume" :: held 1.454s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Created reservations ['da74a026-4fb0-4f78-939c-54c25b307485', '9b63d768-40e8-4c6a-8be6-ddcf0971b16c', '519001c2-6afa-40f0-8605-ee5af23d641f', '73c80fee-3188-4e20-95d0-0057628f1ecc'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:57 devstack sudo[85395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:32:57 devstack sudo[85395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-9c038bdc-bbd6-4980-afcd-ade96198aec1-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:57 devstack sudo[85400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:32:57 devstack sudo[85400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-9c038bdc-bbd6-4980-afcd-ade96198aec1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-quobyte-9c038bdc-bbd6-4980-afcd-ade96198aec1" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-9c038bdc-bbd6-4980-afcd-ade96198aec1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Deleting offline snapshot 9c038bdc-bbd6-4980-afcd-ade96198aec1 of volume c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:32:57 devstack sudo[85392]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] snapshot_file for this snap is: volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a" returned: 0 in 0.803s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6799738-bd87-4dc1-bac1-a9d4a17a33f1]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:57 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a Apr 10 10:32:57 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:57 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 Apr 10 10:32:57 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:58 devstack sudo[85395]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.895s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Deleted volume successfully. Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a7b5f67a-8a40-4357-ab53-fd6f438abcd9 tempest-VolumesTestJSON-284863680 None] Lock "cinder-b9dc2518-78a5-4d9d-b7d9-26453e301e94-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:58 devstack sudo[85400]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.855s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:58 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106.ac1fe1d3-7656-4564-956e-cddef29b334a" returned: 0 in 0.932s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Lock "cinder-quobyte-ac1fe1d3-7656-4564-956e-cddef29b334a" released by "_delete_snapshot" :: held 3.373s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Lock "cinder-quobyte-a4358ae5-a251-4449-b676-851b8c5f1106" released by "delete_snapshot" :: held 3.392s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:58 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1" returned: 0 in 0.991s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99d4144-efbc-408f-af90-3c425a44f86f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:58 devstack cinder-volume[83037]: WARNING cinder.quota [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-28943020 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-28943020, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:58 devstack cinder-volume[83037]: WARNING cinder.quota [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-28943020 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-28943020, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:58 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] Created reservations ['524aca71-dab7-45fe-b9d8-70c60dc606bb', 'e5ee9985-0c21-48c8-bd8b-5246fc97af84', 'eaeec20c-248e-4dfc-9cdb-11b9788d85d5', '29acdd7c-c37d-493d-9b36-c502c15be2e2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:58 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:32:58 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0f419ba8-e336-4caf-bfe3-4f6768919e31 tempest-GroupSnapshotsV319Test-792895560 None] group_snapshot 62ada887-228f-427c-ba0a-8dd423d8f586: deleted successfully Apr 10 10:32:59 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.748s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:32:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:59 devstack sudo[85418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 Apr 10 10:32:59 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Acquiring lock "cinder-quobyte-a4358ae5-a251-4449-b676-851b8c5f1106" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Lock "cinder-quobyte-a4358ae5-a251-4449-b676-851b8c5f1106" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[be92e044-b541-4ff7-8c79-c309920dea41]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:00 devstack sudo[85420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 Apr 10 10:33:00 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:00 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1" returned: 0 in 0.793s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:00 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1 Apr 10 10:33:00 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:00 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106" returned: 0 in 0.702s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:00 devstack sudo[85430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106 Apr 10 10:33:00 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:01 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.9c038bdc-bbd6-4980-afcd-ade96198aec1" returned: 0 in 0.638s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-9c038bdc-bbd6-4980-afcd-ade96198aec1" released by "_delete_snapshot" :: held 3.272s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" released by "delete_snapshot" :: held 3.293s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Created reservations ['a8961c5f-fc08-430a-8248-bcbb54d01304', 'b542f1ee-ab6d-4fd7-ad3d-afe9e9b270c9', '45f4275a-e083-4432-b11f-99553e11c954', '9699c81a-f29d-4995-997f-6b16ca9c7445'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:01 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Delete snapshot completed successfully. Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f1863921-aa46-44ee-b1cc-f69cc719ad74 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-9c038bdc-bbd6-4980-afcd-ade96198aec1-delete_snapshot" released by "delete_snapshot" :: held 3.490s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:01 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4358ae5-a251-4449-b676-851b8c5f1106" returned: 0 in 0.791s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Lock "cinder-quobyte-a4358ae5-a251-4449-b676-851b8c5f1106" released by "delete_volume" :: held 1.540s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Created reservations ['c5ea15dd-8e4f-4d50-9e2b-ff8c41942274'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:01 devstack cinder-volume[83037]: WARNING cinder.quota [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-28943020 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-28943020, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Created reservations ['de8af6a8-6880-4a87-ad0a-8b348d027009', 'ea7e0880-d7b2-4315-8424-c94a919d6f1e', '2b4858a3-8d4f-41ec-94e0-f0aeca583f2c', '51c2718c-23a7-4790-b77c-9eba8c41391f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:01 devstack sudo[85434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:33:01 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] Creating offline snapshot e87a5942-5860-4357-a079-0f84c0c8f0e1 of volume c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:33:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cefd03-e714-4d5a-a1b4-91bea639356c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:02 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:02 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:33:02 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.847s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:02 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:02 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-72571688-be44-428e-a7d0-d20f1829086c tempest-GroupSnapshotsV319Test-792895560 None] Delete group completed successfully. Apr 10 10:33:03 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.880s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:03 devstack sudo[85443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 1G Apr 10 10:33:03 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:04 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 1G" returned: 0 in 0.834s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:04 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 Apr 10 10:33:04 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:04 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1" returned: 0 in 0.732s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:04 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 is being set with open permissions: ugo+rw Apr 10 10:33:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:04 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 Apr 10 10:33:04 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:05 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1" returned: 0 in 0.653s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.273s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-52e2b9cf-3a7f-45f0-9c47-509e0b169464 tempest-SnapshotsActionsTest-235934814 None] Create snapshot completed successfully Apr 10 10:33:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-e87a5942-5860-4357-a079-0f84c0c8f0e1-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-e87a5942-5860-4357-a079-0f84c0c8f0e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-quobyte-e87a5942-5860-4357-a079-0f84c0c8f0e1" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-e87a5942-5860-4357-a079-0f84c0c8f0e1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Deleting offline snapshot e87a5942-5860-4357-a079-0f84c0c8f0e1 of volume c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:33:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] snapshot_file for this snap is: volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:33:06 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2baa28-cafb-4a19-8c8e-89abd3091d42]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:07 devstack sudo[85457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 Apr 10 10:33:07 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:07 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1" returned: 0 in 0.916s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87e8d4a-24c5-418f-ae6a-2ea93c018c7f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:07 devstack sudo[85462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:33:07 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:08 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.966s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:08 devstack sudo[85467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 Apr 10 10:33:08 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5cd11664-8ea5-47da-acba-554bc41865fb tempest-GroupsTest-1106730310 None] Group tempest-Group1-1529179431: creating Apr 10 10:33:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5cd11664-8ea5-47da-acba-554bc41865fb tempest-GroupsTest-1106730310 None] Group tempest-Group1-1529179431: created successfully Apr 10 10:33:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5cd11664-8ea5-47da-acba-554bc41865fb tempest-GroupsTest-1106730310 None] Create group completed successfully. Apr 10 10:33:09 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1" returned: 0 in 0.964s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:09 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1 Apr 10 10:33:09 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:10 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.e87a5942-5860-4357-a079-0f84c0c8f0e1" returned: 0 in 0.738s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-e87a5942-5860-4357-a079-0f84c0c8f0e1" released by "_delete_snapshot" :: held 3.666s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" released by "delete_snapshot" :: held 3.688s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:10 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Created reservations ['13e17710-aa3b-4388-96f4-9900397e503f', 'd888650b-6385-4c53-89a2-e0c4f8155893', 'e42df0d6-0ab8-468f-b712-bff437a61cf0', '0d48b8cb-ad8a-48b6-ae40-0727c87abb14'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Delete snapshot completed successfully. Apr 10 10:33:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-40461c1e-1629-44e4-ad63-665a36b4fe11 tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-e87a5942-5860-4357-a079-0f84c0c8f0e1-delete_snapshot" released by "delete_snapshot" :: held 3.821s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-326d3f84-7af3-4b38-b7b9-9b6e1ee0dacc tempest-GroupsTest-1106730310 None] Group tempest-Group2-736173457: creating Apr 10 10:33:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-326d3f84-7af3-4b38-b7b9-9b6e1ee0dacc tempest-GroupsTest-1106730310 None] Group tempest-Group2-736173457: created successfully Apr 10 10:33:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-326d3f84-7af3-4b38-b7b9-9b6e1ee0dacc tempest-GroupsTest-1106730310 None] Create group completed successfully. Apr 10 10:33:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] Creating offline snapshot a7359c0e-50a6-4452-be0a-0c4dea6ab97e of volume c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:33:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fe2645-4b96-431a-be75-da3bc9190f71]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:11 devstack sudo[85476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:33:11 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:12 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.712s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:12 devstack sudo[85482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e 1G Apr 10 10:33:12 devstack sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Flow 'volume_create_manager' (309b831e-c950-4eeb-9caa-9b41fb68b6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283e5dbd-a843-4b3c-a1be-cbe9c23b7ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283e5dbd-a843-4b3c-a1be-cbe9c23b7ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-530697453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a62bc4d-2fb8-4e27-8e01-b598bb00439c,host='devstack@QuobyteHD#QuobyteHD',id=be99d2e8-e66f-415f-8cd4-3dd60f9590e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1476578fd4b498e375b82fe9f7404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:12Z,use_quota=True,user_id='7c29d2badfb14cb4bc99a9a1725f3306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c41c9db-c7c3-4805-a5f3-fb66c86ab5d6),volume_type_id=7c41c9db-c7c3-4805-a5f3-fb66c86ab5d6)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ea3639-309e-4309-8f15-33335a36aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ea3639-309e-4309-8f15-33335a36aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6071f134-989c-4cd1-b42c-1588162dc14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6071f134-989c-4cd1-b42c-1588162dc14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be99d2e8-e66f-415f-8cd4-3dd60f9590e7', 'volume_name': 'volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34670fd-7d5d-48e6-ad01-166a4af1c78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34670fd-7d5d-48e6-ad01-166a4af1c78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c843234-3491-432a-bc8f-659127608083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:12 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Volume be99d2e8-e66f-415f-8cd4-3dd60f9590e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7', 'volume_size': 1} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:12 devstack sudo[85482]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e 1G" returned: 0 in 0.753s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:13 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e Apr 10 10:33:13 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:13 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e" returned: 0 in 0.757s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:13 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e is being set with open permissions: ugo+rw Apr 10 10:33:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:13 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e Apr 10 10:33:13 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:14 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e" returned: 0 in 0.611s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.833s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8a62bc4d-2fb8-4e27-8e01-b598bb00439c,created_at=2026-04-10T08:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-530697453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8a62bc4d-2fb8-4e27-8e01-b598bb00439c,host='devstack@QuobyteHD#QuobyteHD',id=be99d2e8-e66f-415f-8cd4-3dd60f9590e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1476578fd4b498e375b82fe9f7404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:12Z,use_quota=True,user_id='7c29d2badfb14cb4bc99a9a1725f3306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c41c9db-c7c3-4805-a5f3-fb66c86ab5d6),volume_type_id=7c41c9db-c7c3-4805-a5f3-fb66c86ab5d6)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Creating volume be99d2e8-e66f-415f-8cd4-3dd60f9590e7 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:14 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:14 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7 1073741824 Apr 10 10:33:14 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e0fba572-2036-4016-a6d8-f89e8af7237b tempest-SnapshotsActionsTest-235934814 None] Create snapshot completed successfully Apr 10 10:33:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-fe230d1d-ae73-4fad-aad5-7ec650ea0e35 tempest-GroupsV314Test-1175397143 None] Group tempest-GroupsV314Test-Group-1272225222: creating Apr 10 10:33:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-fe230d1d-ae73-4fad-aad5-7ec650ea0e35 tempest-GroupsV314Test-1175397143 None] Group tempest-GroupsV314Test-Group-1272225222: created successfully Apr 10 10:33:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-fe230d1d-ae73-4fad-aad5-7ec650ea0e35 tempest-GroupsV314Test-1175397143 None] Create group completed successfully. Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-a7359c0e-50a6-4452-be0a-0c4dea6ab97e-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-a7359c0e-50a6-4452-be0a-0c4dea6ab97e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Acquiring lock "cinder-quobyte-a7359c0e-50a6-4452-be0a-0c4dea6ab97e" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-a7359c0e-50a6-4452-be0a-0c4dea6ab97e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Deleting offline snapshot a7359c0e-50a6-4452-be0a-0c4dea6ab97e of volume c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] snapshot_file for this snap is: volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9a1559-ebbc-42f3-a193-d00b0065c443]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:14 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e Apr 10 10:33:14 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:15 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7 1073741824" returned: 0 in 0.782s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:15 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7 Apr 10 10:33:15 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:15 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e" returned: 0 in 0.706s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dbe041-4609-4122-847c-81d42232aa18]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:15 devstack sudo[85507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:33:15 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:15 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7" returned: 0 in 0.681s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c843234-3491-432a-bc8f-659127608083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea7340f-309f-48d4-996c-c0cc5117431a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:15 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Volume volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7 (be99d2e8-e66f-415f-8cd4-3dd60f9590e7): created successfully Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea7340f-309f-48d4-996c-c0cc5117431a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Flow 'volume_create_manager' (309b831e-c950-4eeb-9caa-9b41fb68b6a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a990ff0d-1785-436a-89f6-00bd30efa557 tempest-GroupsTest-1106730310 None] Created volume successfully. Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Flow 'volume_create_manager' (7b995ec5-da3b-478c-84ca-2c3b82d0c992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fccb5a-2156-4597-867b-31d8cf2af84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fccb5a-2156-4597-867b-31d8cf2af84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-699934913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0005428b-5bff-4f48-8e77-99d80b75c1fc,host='devstack@QuobyteHD#QuobyteHD',id=5f08cbfc-fd0a-4b48-86d2-956fde481b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09e8063c138454081d3db18a12bf71c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:16Z,use_quota=True,user_id='2b9ef78017fd4643b050e3d0ffb5f460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e07085a5-d5f0-40ed-b1ec-35641295e1ae),volume_type_id=e07085a5-d5f0-40ed-b1ec-35641295e1ae)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff956330-a27a-4a96-8bca-265b894c7ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff956330-a27a-4a96-8bca-265b894c7ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873cf297-b5b1-4eeb-bbeb-21135e7218b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873cf297-b5b1-4eeb-bbeb-21135e7218b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f08cbfc-fd0a-4b48-86d2-956fde481b4f', 'volume_name': 'volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2bc053-4882-4c13-adf5-04a3b38c18f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2bc053-4882-4c13-adf5-04a3b38c18f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17721cc7-c77a-4883-a21d-22bb64172d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:16 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Volume 5f08cbfc-fd0a-4b48-86d2-956fde481b4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f', 'volume_size': 1} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0005428b-5bff-4f48-8e77-99d80b75c1fc,created_at=2026-04-10T08:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-699934913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0005428b-5bff-4f48-8e77-99d80b75c1fc,host='devstack@QuobyteHD#QuobyteHD',id=5f08cbfc-fd0a-4b48-86d2-956fde481b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09e8063c138454081d3db18a12bf71c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:16Z,use_quota=True,user_id='2b9ef78017fd4643b050e3d0ffb5f460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e07085a5-d5f0-40ed-b1ec-35641295e1ae),volume_type_id=e07085a5-d5f0-40ed-b1ec-35641295e1ae)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Creating volume 5f08cbfc-fd0a-4b48-86d2-956fde481b4f {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:16 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:16 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f 1073741824 Apr 10 10:33:16 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:16 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.755s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:16 devstack sudo[85517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e Apr 10 10:33:16 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:16 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f 1073741824" returned: 0 in 0.671s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:16 devstack sudo[85526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f Apr 10 10:33:16 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:17 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e" returned: 0 in 0.773s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:17 devstack sudo[85528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e Apr 10 10:33:17 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Acquiring lock "cinder-quobyte-be99d2e8-e66f-415f-8cd4-3dd60f9590e7" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Lock "cinder-quobyte-be99d2e8-e66f-415f-8cd4-3dd60f9590e7" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa22b3f9-48d0-452c-b400-f3a016cd8ea1]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:17 devstack sudo[85530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7 Apr 10 10:33:17 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:17 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f" returned: 0 in 0.588s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17721cc7-c77a-4883-a21d-22bb64172d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c2cbab-6bd1-4c81-9b42-b233a7b7e3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:17 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Volume volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f (5f08cbfc-fd0a-4b48-86d2-956fde481b4f): created successfully Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c2cbab-6bd1-4c81-9b42-b233a7b7e3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Flow 'volume_create_manager' (7b995ec5-da3b-478c-84ca-2c3b82d0c992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ef354923-de8a-4b84-944f-ecd01a125974 tempest-GroupsV314Test-1175397143 None] Created volume successfully. Apr 10 10:33:17 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.a7359c0e-50a6-4452-be0a-0c4dea6ab97e" returned: 0 in 0.572s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-a7359c0e-50a6-4452-be0a-0c4dea6ab97e" released by "_delete_snapshot" :: held 2.883s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" released by "delete_snapshot" :: held 2.898s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Created reservations ['65d16585-7e51-4df7-a029-2ca73956745b', '25c4b39a-e6c0-4c20-a62c-55d8f33ee314', 'd398d289-cb16-499a-9d5b-832d7876346b', 'c1634fc7-c1fe-498c-a335-de8c1071a1c5'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Delete snapshot completed successfully. Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f3559563-1106-4944-afcf-462117aceafd tempest-SnapshotsActionsTest-1988817115 None] Lock "cinder-a7359c0e-50a6-4452-be0a-0c4dea6ab97e-delete_snapshot" released by "delete_snapshot" :: held 2.999s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:17 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7" returned: 0 in 0.643s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:17 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7 Apr 10 10:33:17 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "cinder-0b99a8e5-be56-48c9-8964-8d9ce895e103-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Lock "cinder-0b99a8e5-be56-48c9-8964-8d9ce895e103-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "cinder-quobyte-0b99a8e5-be56-48c9-8964-8d9ce895e103" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Lock "cinder-quobyte-0b99a8e5-be56-48c9-8964-8d9ce895e103" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Deleting offline snapshot 0b99a8e5-be56-48c9-8964-8d9ce895e103 of volume c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] snapshot_file for this snap is: volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a651bf05-8245-45c8-9d50-7b253e6ebe98]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:18 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:33:18 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:18 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-be99d2e8-e66f-415f-8cd4-3dd60f9590e7" returned: 0 in 0.598s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Lock "cinder-quobyte-be99d2e8-e66f-415f-8cd4-3dd60f9590e7" released by "delete_volume" :: held 1.273s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Created reservations ['c9c2f2c7-0c6e-4eb2-9efe-b3345167f39f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:18 devstack cinder-volume[83037]: WARNING cinder.quota [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1786887040 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1786887040, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:18 devstack cinder-volume[83037]: WARNING cinder.quota [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1786887040 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1786887040, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Created reservations ['d5626078-2b70-4bce-914e-c3217fca868f', 'ae15e943-1ecd-4350-99bf-80394e9d2c8d', '911d1fb1-9f64-46af-96fb-292b69b2c0cf', '1773b17b-b403-4f34-b5ff-5c13bf38358c'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:18 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:33:18 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:19 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.671s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4266e52-5a15-41f0-95b4-060ff6d70a53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5235894-840a-466a-861a-2de4dd6beac3]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:19 devstack sudo[85547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 Apr 10 10:33:19 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:19 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Cloning volume 5f08cbfc-fd0a-4b48-86d2-956fde481b4f to volume 2aa3fa02-83e1-45bf-bf11-d3d6d774de0b Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Creating offline snapshot 02bd2f89-6b83-429f-ab6d-a95f3447a973 of volume 5f08cbfc-fd0a-4b48-86d2-956fde481b4f {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dacca55-3ab5-4f21-a064-e670edc2d7cb]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:19 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.620s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-93725e56-2846-4160-9408-f6d77c5326cb tempest-GroupsTest-1106730310 None] Delete group completed successfully. Apr 10 10:33:19 devstack sudo[85556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f Apr 10 10:33:19 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ed9130ce-c070-4ef1-8e7c-5754e8a80753 tempest-GroupsTest-1106730310 None] Created reservations ['b6ce6c64-8893-4ddf-9a46-be0e03a3518b'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed9130ce-c070-4ef1-8e7c-5754e8a80753 tempest-GroupsTest-1106730310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed9130ce-c070-4ef1-8e7c-5754e8a80753 tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed9130ce-c070-4ef1-8e7c-5754e8a80753 tempest-GroupsTest-1106730310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ed9130ce-c070-4ef1-8e7c-5754e8a80753 tempest-GroupsTest-1106730310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ed9130ce-c070-4ef1-8e7c-5754e8a80753 tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ed9130ce-c070-4ef1-8e7c-5754e8a80753 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:19 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:33:19 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:19 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53" returned: 0 in 0.745s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:19 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:33:19 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:20 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f" returned: 0 in 0.802s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:20 devstack sudo[85569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 1G Apr 10 10:33:20 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:20 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ed9130ce-c070-4ef1-8e7c-5754e8a80753 tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.506s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:20 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ed9130ce-c070-4ef1-8e7c-5754e8a80753 tempest-GroupsTest-1106730310 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ed9130ce-c070-4ef1-8e7c-5754e8a80753 tempest-GroupsTest-1106730310 None] Delete group completed successfully. Apr 10 10:33:20 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.672s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:20 devstack sudo[85574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103 Apr 10 10:33:20 devstack sudo[85574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:20 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 1G" returned: 0 in 0.755s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:20 devstack sudo[85579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 Apr 10 10:33:20 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:21 devstack sudo[85574]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53.0b99a8e5-be56-48c9-8964-8d9ce895e103" returned: 0 in 0.645s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Lock "cinder-quobyte-0b99a8e5-be56-48c9-8964-8d9ce895e103" released by "_delete_snapshot" :: held 2.838s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" released by "delete_snapshot" :: held 2.852s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4d200284-dc35-43ad-8353-b250b0cced46 tempest-GroupsTest-1106730310 None] Group tempest-GroupsTest-Group-1728375889: creating Apr 10 10:33:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4d200284-dc35-43ad-8353-b250b0cced46 tempest-GroupsTest-1106730310 None] Group tempest-GroupsTest-Group-1728375889: created successfully Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Created reservations ['8db77620-e81c-4675-ac93-2d2608d2da7f', '503ba855-d4fc-469b-9929-89efd85906c1', '9e4eb623-0254-45c2-9af4-5f368a6140e2', '0bc34b40-ed62-4eeb-9f40-21c40a6d9630'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4d200284-dc35-43ad-8353-b250b0cced46 tempest-GroupsTest-1106730310 None] Create group completed successfully. Apr 10 10:33:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Delete snapshot completed successfully. Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-219ff3c4-1e66-4612-afc9-696b12a06eef tempest-SnapshotsActionsTest-235934814 None] Lock "cinder-0b99a8e5-be56-48c9-8964-8d9ce895e103-delete_snapshot" released by "delete_snapshot" :: held 3.016s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:21 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973" returned: 0 in 0.763s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:21 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:21 devstack sudo[85586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 Apr 10 10:33:21 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "cinder-c4266e52-5a15-41f0-95b4-060ff6d70a53-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Lock "cinder-c4266e52-5a15-41f0-95b4-060ff6d70a53-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" acquired by "delete_volume" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bea91d-2fd5-46f2-a24e-b3ecbd880be5]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:21 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 Apr 10 10:33:21 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:22 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973" returned: 0 in 0.510s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:22 devstack sudo[85607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.info Apr 10 10:33:22 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:22 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53" returned: 0 in 0.646s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:22 devstack sudo[85612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53 Apr 10 10:33:22 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:22 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.info" returned: 0 in 0.534s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:22 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:22 devstack sudo[85615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.info Apr 10 10:33:22 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Flow 'volume_create_manager' (0cd32344-1f73-4446-ad32-05f60a9fa1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096ccdf6-43bf-41a8-8121-470fa0c6465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096ccdf6-43bf-41a8-8121-470fa0c6465a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-103902244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9e58253-e1e5-47d0-b88e-e132c8f3f696,host='devstack@QuobyteHD#QuobyteHD',id=40bbe6c9-1825-4c34-abdc-b3492cf911fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1476578fd4b498e375b82fe9f7404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:23Z,use_quota=True,user_id='7c29d2badfb14cb4bc99a9a1725f3306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d5fd060-a539-4227-a53c-d26916f083dc),volume_type_id=0d5fd060-a539-4227-a53c-d26916f083dc)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bce1cf6-8307-42d9-b942-a4a37fc0b85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bce1cf6-8307-42d9-b942-a4a37fc0b85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d38d1d-e791-440b-9c27-bb8698da76bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d38d1d-e791-440b-9c27-bb8698da76bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40bbe6c9-1825-4c34-abdc-b3492cf911fb', 'volume_name': 'volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5724eee8-c14f-403b-a2f9-2ac055317a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5724eee8-c14f-403b-a2f9-2ac055317a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179df467-3481-4f44-a063-2e7c10bc81db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Volume 40bbe6c9-1825-4c34-abdc-b3492cf911fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb', 'volume_size': 1} Apr 10 10:33:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:23 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c4266e52-5a15-41f0-95b4-060ff6d70a53" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Lock "cinder-quobyte-c4266e52-5a15-41f0-95b4-060ff6d70a53" released by "delete_volume" :: held 1.323s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Created reservations ['4924f4f8-2aec-4e32-9669-0fe67fc899d1', '7a4fe785-1659-49c8-b849-6aefaa67c01b', '78f3e4f5-4e1d-4986-8768-85fae791a7e2', '07d6ba3d-f683-4da1-aa9b-6560c6a25259'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:23 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.info" returned: 0 in 0.484s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Acquiring lock "cinder-quobyte-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Lock "cinder-quobyte-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] snapshot: 02bd2f89-6b83-429f-ab6d-a95f3447a973, volume: 2aa3fa02-83e1-45bf-bf11-d3d6d774de0b, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:33:23 devstack sudo[85619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:33:23 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c91d13-ef6f-45bc-a6b8-de177cd0e184]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:23 devstack sudo[85621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 Apr 10 10:33:23 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:23 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.564s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Deleted volume successfully. Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ba7418ef-9368-466e-ac89-69185a4609ea tempest-SnapshotsActionsTest-235934814 None] Lock "cinder-c4266e52-5a15-41f0-95b4-060ff6d70a53-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:23 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973" returned: 0 in 0.663s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[87075495-2287-4058-967d-74afead1a09d]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:23 devstack sudo[85627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f Apr 10 10:33:23 devstack sudo[85627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:24 devstack sudo[85627]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f" returned: 0 in 0.597s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:24 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:33:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:24 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b Apr 10 10:33:24 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:27 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b" returned: 0 in 3.244s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fcf08f-5fa3-4aa5-96a5-cdcbb2fa3bd5]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:27 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f Apr 10 10:33:27 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:29 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f" returned: 0 in 1.364s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:29 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f, size 1024.00 MB, duration 3.25 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:33:29 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Converted 1024.00 MB image at 315.50 MB/s Apr 10 10:33:29 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:33:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:29 devstack sudo[85712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b Apr 10 10:33:29 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:29 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b" returned: 0 in 0.557s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Lock "cinder-quobyte-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b" released by "_copy_volume_from_snapshot" :: held 6.504s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Acquiring lock "cinder-quobyte-02bd2f89-6b83-429f-ab6d-a95f3447a973" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Lock "cinder-quobyte-02bd2f89-6b83-429f-ab6d-a95f3447a973" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Deleting offline snapshot 02bd2f89-6b83-429f-ab6d-a95f3447a973 of volume 5f08cbfc-fd0a-4b48-86d2-956fde481b4f {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:33:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] snapshot_file for this snap is: volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:33:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f0e602-683d-4321-9b88-3d441ee74736]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:29 devstack sudo[85715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 Apr 10 10:33:29 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Flow 'volume_create_manager' (9ced546a-6c70-4839-928a-510e3b8d4448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effd053f-2c74-483e-989d-627655e349cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effd053f-2c74-483e-989d-627655e349cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-693714185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085d3303-c305-4cce-9b96-2ee3b681826c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08d4d4815d1d4fba8c4d92f8aeb1f8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:30Z,use_quota=True,user_id='af36f1a24402468abc0beda727421223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cb436b-e992-4735-8d0d-837171f60535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cb436b-e992-4735-8d0d-837171f60535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab25c59-2f48-45a4-8072-13a88eb7671c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab25c59-2f48-45a4-8072-13a88eb7671c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085d3303-c305-4cce-9b96-2ee3b681826c', 'volume_name': 'volume-085d3303-c305-4cce-9b96-2ee3b681826c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bceeab5-9b91-4f20-b604-3ad0ca2b2812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bceeab5-9b91-4f20-b604-3ad0ca2b2812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbed4196-6508-4d03-8ea8-4bd00b4a3132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:30 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Volume 085d3303-c305-4cce-9b96-2ee3b681826c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085d3303-c305-4cce-9b96-2ee3b681826c', 'volume_size': 1} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:30 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973" returned: 0 in 0.807s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9f10af-6e48-479a-b30c-00202f2357db]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:30 devstack sudo[85720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f Apr 10 10:33:30 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:31 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f" returned: 0 in 0.704s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:31 devstack sudo[85726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 Apr 10 10:33:31 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:31 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973" returned: 0 in 0.636s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:31 devstack sudo[85731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973 Apr 10 10:33:31 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:32 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f.02bd2f89-6b83-429f-ab6d-a95f3447a973" returned: 0 in 0.496s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Lock "cinder-quobyte-02bd2f89-6b83-429f-ab6d-a95f3447a973" released by "_delete_snapshot" :: held 2.724s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.253s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.655s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9e58253-e1e5-47d0-b88e-e132c8f3f696,created_at=2026-04-10T08:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-103902244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9e58253-e1e5-47d0-b88e-e132c8f3f696,host='devstack@QuobyteHD#QuobyteHD',id=40bbe6c9-1825-4c34-abdc-b3492cf911fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1476578fd4b498e375b82fe9f7404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:23Z,use_quota=True,user_id='7c29d2badfb14cb4bc99a9a1725f3306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d5fd060-a539-4227-a53c-d26916f083dc),volume_type_id=0d5fd060-a539-4227-a53c-d26916f083dc)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Creating volume 40bbe6c9-1825-4c34-abdc-b3492cf911fb {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:32 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:33:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:32 devstack sudo[85735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb 1073741824 Apr 10 10:33:32 devstack sudo[85735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-79eb9f31-986d-4e85-bb8a-9f4ef36d9dd0 tempest-GroupsV314Test-1175397143 None] Create group from source-group-0005428b-5bff-4f48-8e77-99d80b75c1fc completed successfully. Apr 10 10:33:33 devstack sudo[85735]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb 1073741824" returned: 0 in 0.666s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:33 devstack sudo[85740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb Apr 10 10:33:33 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Acquiring lock "cinder-quobyte-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Lock "cinder-quobyte-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e9e4fa-b38c-4e34-aa22-3fb1c7f58521]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:33 devstack sudo[85742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b Apr 10 10:33:33 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:33 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb" returned: 0 in 0.535s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.230s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-693714185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085d3303-c305-4cce-9b96-2ee3b681826c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08d4d4815d1d4fba8c4d92f8aeb1f8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:30Z,use_quota=True,user_id='af36f1a24402468abc0beda727421223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Creating volume 085d3303-c305-4cce-9b96-2ee3b681826c {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:33 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179df467-3481-4f44-a063-2e7c10bc81db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:33 devstack sudo[85745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c 1073741824 Apr 10 10:33:33 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302b5dcf-f603-4744-8718-08fd7cc1fd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:33 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Volume volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb (40bbe6c9-1825-4c34-abdc-b3492cf911fb): created successfully Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302b5dcf-f603-4744-8718-08fd7cc1fd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Flow 'volume_create_manager' (0cd32344-1f73-4446-ad32-05f60a9fa1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7813a16f-67e5-4483-ba0d-5c3799173cf0 tempest-GroupsTest-1106730310 None] Created volume successfully. Apr 10 10:33:33 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b" returned: 0 in 0.552s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:34 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b Apr 10 10:33:34 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:34 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c 1073741824" returned: 0 in 0.704s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:34 devstack sudo[85759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c Apr 10 10:33:34 devstack sudo[85759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:34 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b" returned: 0 in 0.785s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Lock "cinder-quobyte-2aa3fa02-83e1-45bf-bf11-d3d6d774de0b" released by "delete_volume" :: held 1.389s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Flow 'volume_create_manager' (1da292fe-3013-4025-a137-daa47dc285f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d123acf-25a3-4c4a-9a9b-056c1423d424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d123acf-25a3-4c4a-9a9b-056c1423d424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-525685923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9e58253-e1e5-47d0-b88e-e132c8f3f696,host='devstack@QuobyteHD#QuobyteHD',id=046bdcf9-de5a-4146-88ba-3db04c56ac65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1476578fd4b498e375b82fe9f7404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:35Z,use_quota=True,user_id='7c29d2badfb14cb4bc99a9a1725f3306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d5fd060-a539-4227-a53c-d26916f083dc),volume_type_id=0d5fd060-a539-4227-a53c-d26916f083dc)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a063f5e-9168-4d6f-b0e0-d48e413fae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a063f5e-9168-4d6f-b0e0-d48e413fae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad28dd7-b31b-4fb5-8b4f-1cd26bd19708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad28dd7-b31b-4fb5-8b4f-1cd26bd19708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046bdcf9-de5a-4146-88ba-3db04c56ac65', 'volume_name': 'volume-046bdcf9-de5a-4146-88ba-3db04c56ac65', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f8ead9-350d-4802-b7bf-b7d532188066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f8ead9-350d-4802-b7bf-b7d532188066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09eeb9b7-c069-4ce3-899e-c1bacdd564e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:34 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Volume 046bdcf9-de5a-4146-88ba-3db04c56ac65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046bdcf9-de5a-4146-88ba-3db04c56ac65', 'volume_size': 1} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Created reservations ['650b2ad7-8143-4f7c-a90a-c60d3da6a7a1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:34 devstack cinder-volume[83037]: WARNING cinder.quota [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-434193463 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-434193463, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:34 devstack cinder-volume[83037]: WARNING cinder.quota [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-434193463 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-434193463, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:34 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Created reservations ['119d6805-6703-4467-b9b7-e1e22cca45d3', '18e1f312-3ce9-4ba9-b8d5-3ebca9bd8cea', '532e6906-5078-43d0-9490-698c081f7c74', '820139bb-f292-44c4-8fb0-46c74be46ed2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:35 devstack sudo[85785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:33:35 devstack sudo[85785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:35 devstack sudo[85759]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c" returned: 0 in 0.727s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f9e58253-e1e5-47d0-b88e-e132c8f3f696,created_at=2026-04-10T08:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-525685923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f9e58253-e1e5-47d0-b88e-e132c8f3f696,host='devstack@QuobyteHD#QuobyteHD',id=046bdcf9-de5a-4146-88ba-3db04c56ac65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cde1476578fd4b498e375b82fe9f7404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:35Z,use_quota=True,user_id='7c29d2badfb14cb4bc99a9a1725f3306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d5fd060-a539-4227-a53c-d26916f083dc),volume_type_id=0d5fd060-a539-4227-a53c-d26916f083dc)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Creating volume 046bdcf9-de5a-4146-88ba-3db04c56ac65 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:35 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbed4196-6508-4d03-8ea8-4bd00b4a3132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085d3303-c305-4cce-9b96-2ee3b681826c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:35 devstack sudo[85787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65 1073741824 Apr 10 10:33:35 devstack sudo[85787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a397c076-0599-44c2-9959-dd1335289e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:35 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Volume volume-085d3303-c305-4cce-9b96-2ee3b681826c (085d3303-c305-4cce-9b96-2ee3b681826c): created successfully Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a397c076-0599-44c2-9959-dd1335289e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Flow 'volume_create_manager' (9ced546a-6c70-4839-928a-510e3b8d4448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:35 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-de3fdb8e-c517-4a21-a2ce-3382046cb47f tempest-VolumeQuotasNegativeTestJSON-64467379 None] Created volume successfully. Apr 10 10:33:35 devstack sudo[85785]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:35 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c36db01f-70ff-483b-b52a-66e37c0c23c8 tempest-GroupsV314Test-1175397143 None] Delete group completed successfully. Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Acquiring lock "cinder-quobyte-5f08cbfc-fd0a-4b48-86d2-956fde481b4f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Lock "cinder-quobyte-5f08cbfc-fd0a-4b48-86d2-956fde481b4f" acquired by "delete_volume" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19f78b4-f391-45f6-87e6-956e2ada6863]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:36 devstack sudo[85787]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65 1073741824" returned: 0 in 0.841s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:36 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65 Apr 10 10:33:36 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:36 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f Apr 10 10:33:36 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:36 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65" returned: 0 in 0.737s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:36 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09eeb9b7-c069-4ce3-899e-c1bacdd564e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046bdcf9-de5a-4146-88ba-3db04c56ac65', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea47f6db-4b41-421c-bc42-dc7e333ff467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f" returned: 0 in 0.885s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:36 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Volume volume-046bdcf9-de5a-4146-88ba-3db04c56ac65 (046bdcf9-de5a-4146-88ba-3db04c56ac65): created successfully Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea47f6db-4b41-421c-bc42-dc7e333ff467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:36 devstack sudo[85801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f Apr 10 10:33:36 devstack sudo[85801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Flow 'volume_create_manager' (1da292fe-3013-4025-a137-daa47dc285f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Acquiring lock "cinder-085d3303-c305-4cce-9b96-2ee3b681826c-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0d86f3c0-94cf-46dc-aa25-d22400087f42 tempest-GroupsTest-1106730310 None] Created volume successfully. Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Lock "cinder-085d3303-c305-4cce-9b96-2ee3b681826c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Acquiring lock "cinder-quobyte-085d3303-c305-4cce-9b96-2ee3b681826c" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Lock "cinder-quobyte-085d3303-c305-4cce-9b96-2ee3b681826c" acquired by "delete_volume" :: waited 0.031s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-29a12c5f-0ed5-4944-b951-0e00fd529edf tempest-GroupsTest-1106730310 None] Update group completed successfully. Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb47ada-43b5-4ab0-9138-c05d1c06f605]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:37 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c Apr 10 10:33:37 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:37 devstack sudo[85801]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f08cbfc-fd0a-4b48-86d2-956fde481b4f" returned: 0 in 0.740s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Lock "cinder-quobyte-5f08cbfc-fd0a-4b48-86d2-956fde481b4f" released by "delete_volume" :: held 1.694s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Created reservations ['5081878f-714d-4c45-ab3b-db0694c867c4'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Created reservations ['69d9cf12-c74d-421e-9142-ebd4b8fc42fd', '46a1e1eb-787e-477d-9bdb-50487f8bd436', '7c9f6122-3a2f-482d-886e-f10c2b8462c7', '9ab747c3-715d-4a13-b646-13ffc25bc2dc'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:37 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:33:37 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:37 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c" returned: 0 in 0.688s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:37 devstack sudo[85811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c Apr 10 10:33:37 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-aba72e14-5e79-4322-88d1-e9b17cbb742c tempest-GroupsTest-1106730310 None] Update group completed successfully. Apr 10 10:33:38 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.838s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:38 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-70809122-f7c3-479e-a51d-05cf759975dd tempest-GroupsV314Test-1175397143 None] Delete group completed successfully. Apr 10 10:33:38 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-085d3303-c305-4cce-9b96-2ee3b681826c" returned: 0 in 0.904s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Lock "cinder-quobyte-085d3303-c305-4cce-9b96-2ee3b681826c" released by "delete_volume" :: held 1.629s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:38 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Created reservations ['952f06a6-4af3-4c8f-bd4e-6bd26ead96f9', 'cb2910b5-e5d0-4078-8187-81d07b6a1ddf', '7b935af1-3377-4183-9e26-9be161e1a2cf', 'bc1aa3d7-b8da-431f-b40a-756120286dc3'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:38 devstack sudo[85815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:33:38 devstack sudo[85815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:39 devstack sudo[85815]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.780s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:39 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Deleted volume successfully. Apr 10 10:33:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ef25e6d9-e2cc-41d8-ad9c-1f01ee5648e9 tempest-VolumeQuotasNegativeTestJSON-64467379 None] Lock "cinder-085d3303-c305-4cce-9b96-2ee3b681826c-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Acquiring lock "cinder-quobyte-046bdcf9-de5a-4146-88ba-3db04c56ac65" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Lock "cinder-quobyte-046bdcf9-de5a-4146-88ba-3db04c56ac65" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:40 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c671d44e-c6f8-446b-bf4b-1716dc760646]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:40 devstack sudo[85818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65 Apr 10 10:33:40 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:41 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65" returned: 0 in 0.945s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:41 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65 Apr 10 10:33:41 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:42 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-046bdcf9-de5a-4146-88ba-3db04c56ac65" returned: 0 in 0.856s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Lock "cinder-quobyte-046bdcf9-de5a-4146-88ba-3db04c56ac65" released by "delete_volume" :: held 1.876s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Acquiring lock "cinder-quobyte-40bbe6c9-1825-4c34-abdc-b3492cf911fb" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Lock "cinder-quobyte-40bbe6c9-1825-4c34-abdc-b3492cf911fb" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:42 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1f775c-7677-421c-88bc-ec4cc2f4c99c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:42 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb Apr 10 10:33:42 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:43 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb" returned: 0 in 0.838s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:43 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb Apr 10 10:33:43 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:43 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40bbe6c9-1825-4c34-abdc-b3492cf911fb" returned: 0 in 0.667s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Lock "cinder-quobyte-40bbe6c9-1825-4c34-abdc-b3492cf911fb" released by "delete_volume" :: held 1.540s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:43 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Created reservations ['3875a70e-5c7c-4b5a-9900-4bf4c7058961'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:43 devstack cinder-volume[83037]: WARNING cinder.quota [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1143854420 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1143854420, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:43 devstack cinder-volume[83037]: WARNING cinder.quota [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1143854420 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1143854420, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:43 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Created reservations ['5adac459-ab4c-4341-8920-68a742f06a47', '918e103a-4038-4399-bfd5-1fa1a99f6da6', '046b888b-d807-4e18-b96e-1592a931a6b4', '2d3ae877-e64c-4a21-81e0-46002b4acda2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:44 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Created reservations ['b1b30a07-75d8-49b7-a2d3-22cf9b0aeb76', '1028c8d2-586c-43d5-a199-fe767b07ddcd', 'bba830ce-20ab-4236-922f-d67d8fd2591a', 'f5770aea-de08-466b-8aa6-ad81fd99ef13'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:44 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:33:44 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:44 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.861s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:45 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-75ec9798-b543-4a0c-b72a-d60f5ea5ace0 tempest-GroupsTest-1106730310 None] Delete group completed successfully. Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Flow 'volume_create_manager' (0058b4c7-c1a4-40f6-83a2-6f70d81b83a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929d2159-e3c0-4c68-9831-9a32d3d1187f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929d2159-e3c0-4c68-9831-9a32d3d1187f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2105137277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5659ff-52b3-414c-9cad-31e42120475a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86f1b1365254bba92e8b7d5477a0e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:46Z,use_quota=True,user_id='37bd8d3342d54a89ae84cf3ae96cfd6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa2d0c8-4a84-4842-a39f-39cf1f6ef2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa2d0c8-4a84-4842-a39f-39cf1f6ef2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dfdb7e-fbd0-4e0c-b1f4-2bf4f6dc219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dfdb7e-fbd0-4e0c-b1f4-2bf4f6dc219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d5659ff-52b3-414c-9cad-31e42120475a', 'volume_name': 'volume-2d5659ff-52b3-414c-9cad-31e42120475a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ec1092-02f9-4aa8-96d7-fa2c1a4c942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ec1092-02f9-4aa8-96d7-fa2c1a4c942b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee419e2-c4cb-411f-a585-5f27e57e15cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Volume 2d5659ff-52b3-414c-9cad-31e42120475a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d5659ff-52b3-414c-9cad-31e42120475a', 'volume_size': 1} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2105137277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5659ff-52b3-414c-9cad-31e42120475a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d86f1b1365254bba92e8b7d5477a0e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:46Z,use_quota=True,user_id='37bd8d3342d54a89ae84cf3ae96cfd6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Creating volume 2d5659ff-52b3-414c-9cad-31e42120475a {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:46 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:33:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:46 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a 1073741824 Apr 10 10:33:46 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Flow 'volume_create_manager' (8b19a8d0-c46d-4738-8c07-70a0f3779826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be29d01-444e-4038-a996-8c725833c989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be29d01-444e-4038-a996-8c725833c989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:47Z,deleted=False,deleted_at=None,display_description='',display_name='e7fdf5d8-2a8f-499f-95c0-3b3a11451bfb-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f04873-8470-42e4-99f9-35317ea6754e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cce5ef1286c45ee9bf9c0ca25acac2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:47Z,use_quota=True,user_id='30499ce0e33745ec93a93e68d060fda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89dc80fd-c1f7-411f-85cc-532518306b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89dc80fd-c1f7-411f-85cc-532518306b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cea114-7642-4ee3-8175-09282ba9d855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cea114-7642-4ee3-8175-09282ba9d855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f04873-8470-42e4-99f9-35317ea6754e', 'volume_name': 'volume-82f04873-8470-42e4-99f9-35317ea6754e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36593249-e2c8-40df-8186-44495db184e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36593249-e2c8-40df-8186-44495db184e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85436cd9-0537-48a4-beac-1fbe9f0a5db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:47 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Volume 82f04873-8470-42e4-99f9-35317ea6754e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f04873-8470-42e4-99f9-35317ea6754e', 'volume_size': 1} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:47 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a 1073741824" returned: 0 in 1.435s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:47 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a Apr 10 10:33:47 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:48 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a" returned: 0 in 0.869s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.363s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.032s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:47Z,deleted=False,deleted_at=None,display_description='',display_name='e7fdf5d8-2a8f-499f-95c0-3b3a11451bfb-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f04873-8470-42e4-99f9-35317ea6754e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cce5ef1286c45ee9bf9c0ca25acac2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:47Z,use_quota=True,user_id='30499ce0e33745ec93a93e68d060fda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Creating volume 82f04873-8470-42e4-99f9-35317ea6754e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:48 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee419e2-c4cb-411f-a585-5f27e57e15cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d5659ff-52b3-414c-9cad-31e42120475a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:48 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e 1073741824 Apr 10 10:33:48 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f56707-a907-44ca-8170-3f447d67c6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:48 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Volume volume-2d5659ff-52b3-414c-9cad-31e42120475a (2d5659ff-52b3-414c-9cad-31e42120475a): created successfully Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0f56707-a907-44ca-8170-3f447d67c6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Flow 'volume_create_manager' (0058b4c7-c1a4-40f6-83a2-6f70d81b83a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-593739a7-3689-4b80-ba27-fad286f6c50c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Created volume successfully. Apr 10 10:33:49 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e 1073741824" returned: 0 in 1.104s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:49 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:UPDATE=202,cinder:SELECT=170,cinder:INSERT=46,cinder:DELETE=10 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:33:49 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=149,cinder:INSERT=42,cinder:UPDATE=160,cinder:DELETE=6 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:33:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:49 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e Apr 10 10:33:49 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:50 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e" returned: 0 in 0.627s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.577s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85436cd9-0537-48a4-beac-1fbe9f0a5db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f04873-8470-42e4-99f9-35317ea6754e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ddd89f-7f64-4ff2-b3d8-cf5309a26a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Creating offline snapshot 9bda7e6a-0836-419d-81db-b71760aba596 of volume 2d5659ff-52b3-414c-9cad-31e42120475a {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:33:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Volume volume-82f04873-8470-42e4-99f9-35317ea6754e (82f04873-8470-42e4-99f9-35317ea6754e): created successfully Apr 10 10:33:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ddd89f-7f64-4ff2-b3d8-cf5309a26a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Flow 'volume_create_manager' (8b19a8d0-c46d-4738-8c07-70a0f3779826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:50 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9128a96-a6a6-4534-ae74-d43834aa9f99]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-ec0e02da-419d-4c35-a109-b43172fbdb7d tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Created volume successfully. Apr 10 10:33:50 devstack sudo[85859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a Apr 10 10:33:50 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:51 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a" returned: 0 in 1.016s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:51 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 1G Apr 10 10:33:51 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:52 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0b10e57f-7135-4635-b964-eacccfa16a50 tempest-GroupsV320Test-597267536 None] Group tempest-GroupsV320Test-Group-587529159: creating Apr 10 10:33:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 1G" returned: 0 in 0.882s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d5659ff-52b3-414c-9cad-31e42120475a -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:52 devstack sudo[85897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d5659ff-52b3-414c-9cad-31e42120475a -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 Apr 10 10:33:52 devstack sudo[85897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0b10e57f-7135-4635-b964-eacccfa16a50 tempest-GroupsV320Test-597267536 None] Group tempest-GroupsV320Test-Group-587529159: created successfully Apr 10 10:33:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0b10e57f-7135-4635-b964-eacccfa16a50 tempest-GroupsV320Test-597267536 None] Create group completed successfully. Apr 10 10:33:53 devstack sudo[85897]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d5659ff-52b3-414c-9cad-31e42120475a -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:53 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 is being set with open permissions: ugo+rw Apr 10 10:33:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:53 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 Apr 10 10:33:53 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:53 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596" returned: 0 in 0.869s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:54 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.info Apr 10 10:33:54 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d6dbd664-f8af-4dd9-b3c1-d175caac85d2 tempest-GroupsV320Test-597267536 None] Created reservations ['19f50cc7-e205-48c2-a7f7-1779e952ea2c'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-87bfa5bd-7bc8-4e37-a69a-e3e9d4584e84 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d6dbd664-f8af-4dd9-b3c1-d175caac85d2 tempest-GroupsV320Test-597267536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d6dbd664-f8af-4dd9-b3c1-d175caac85d2 tempest-GroupsV320Test-597267536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d6dbd664-f8af-4dd9-b3c1-d175caac85d2 tempest-GroupsV320Test-597267536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d6dbd664-f8af-4dd9-b3c1-d175caac85d2 tempest-GroupsV320Test-597267536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d6dbd664-f8af-4dd9-b3c1-d175caac85d2 tempest-GroupsV320Test-597267536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d6dbd664-f8af-4dd9-b3c1-d175caac85d2 tempest-GroupsV320Test-597267536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:54 devstack sudo[85915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:33:54 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:54 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.info" returned: 0 in 0.712s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:54 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.info is being set with open permissions: ugo+rw Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:54 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.info Apr 10 10:33:54 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:54 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d6dbd664-f8af-4dd9-b3c1-d175caac85d2 tempest-GroupsV320Test-597267536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.621s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:54 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-d6dbd664-f8af-4dd9-b3c1-d175caac85d2 tempest-GroupsV320Test-597267536 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d6dbd664-f8af-4dd9-b3c1-d175caac85d2 tempest-GroupsV320Test-597267536 None] Delete group completed successfully. Apr 10 10:33:55 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.info" returned: 0 in 0.601s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.899s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-87bfa5bd-7bc8-4e37-a69a-e3e9d4584e84 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.221s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcf94af-0758-4c51-a6ab-3d0d6c1fbf34]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-87bfa5bd-7bc8-4e37-a69a-e3e9d4584e84 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f44c4d8c-9094-4d4b-8b31-8441d5743fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Create snapshot completed successfully Apr 10 10:33:55 devstack sudo[85922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e Apr 10 10:33:55 devstack sudo[85922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:56 devstack sudo[85922]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-87bfa5bd-7bc8-4e37-a69a-e3e9d4584e84 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e" returned: 0 in 1.009s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-87bfa5bd-7bc8-4e37-a69a-e3e9d4584e84 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.029s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-87bfa5bd-7bc8-4e37-a69a-e3e9d4584e84 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac', 'name': 'volume-82f04873-8470-42e4-99f9-35317ea6754e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb9fb10b-ea03-4058-a785-bfb8a7656a82', 'enforce_multipath': True} {{(pid=83037) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 10:33:56 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-dd4a7c4a-c1a0-4177-be11-87e9fd7a871a req-87bfa5bd-7bc8-4e37-a69a-e3e9d4584e84 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] attachment_update completed successfully. Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Acquiring lock "cinder-9bda7e6a-0836-419d-81db-b71760aba596-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "cinder-9bda7e6a-0836-419d-81db-b71760aba596-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Acquiring lock "cinder-quobyte-2d5659ff-52b3-414c-9cad-31e42120475a" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "cinder-quobyte-2d5659ff-52b3-414c-9cad-31e42120475a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Acquiring lock "cinder-quobyte-9bda7e6a-0836-419d-81db-b71760aba596" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "cinder-quobyte-9bda7e6a-0836-419d-81db-b71760aba596" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Deleting offline snapshot 9bda7e6a-0836-419d-81db-b71760aba596 of volume 2d5659ff-52b3-414c-9cad-31e42120475a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] snapshot_file for this snap is: volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3adf4b-1551-49ac-ad6f-a1597bfec029]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:57 devstack sudo[85927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 Apr 10 10:33:57 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:57 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:33:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:57 devstack sudo[85932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:33:57 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:57 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596" returned: 0 in 0.805s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d5659ff-52b3-414c-9cad-31e42120475a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[108b30c4-e862-4ed2-8cbf-469e570b33db]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:57 devstack sudo[85934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a Apr 10 10:33:57 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:58 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.952s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:58 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a" returned: 0 in 1.055s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:58 devstack sudo[86007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 Apr 10 10:33:58 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:59 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596" returned: 0 in 0.765s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:59 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596 Apr 10 10:33:59 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:00 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a.9bda7e6a-0836-419d-81db-b71760aba596" returned: 0 in 0.789s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "cinder-quobyte-9bda7e6a-0836-419d-81db-b71760aba596" released by "_delete_snapshot" :: held 3.589s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "cinder-quobyte-2d5659ff-52b3-414c-9cad-31e42120475a" released by "delete_snapshot" :: held 3.632s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:00 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Created reservations ['08cd7795-fd41-4071-9120-d30f6e0a5984', '1ac28da8-41db-426e-a3d6-8ffcd4903ff0', '63611fbc-7581-41de-8653-7675dea4281a', '33f63d49-f1ad-4e73-b6ae-a298493e620e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Delete snapshot completed successfully. Apr 10 10:34:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc866c0d-fad6-4e0a-a947-03d662a694a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "cinder-9bda7e6a-0836-419d-81db-b71760aba596-delete_snapshot" released by "delete_snapshot" :: held 3.839s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Flow 'volume_create_manager' (4a386039-9e59-4739-a3a0-3ad76beab918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059a811b-c0e1-46df-ae13-b748dfa5eb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059a811b-c0e1-46df-ae13-b748dfa5eb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1041544205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c54c14f-e6a0-49c3-8d6a-90049fae9b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b33fc35196f4089ac5ded1a9ac84ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:01Z,use_quota=True,user_id='20508ad7a3a6432098be3ff2babd3367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cbf7d78-b713-4e7c-8a1e-a3bbec2acfe7),volume_type_id=0cbf7d78-b713-4e7c-8a1e-a3bbec2acfe7)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1477ef46-b90f-4b1b-b3dc-e7ad348da5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1477ef46-b90f-4b1b-b3dc-e7ad348da5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f61cd4e-4f8c-4b04-8cb2-b22fe57b23b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f61cd4e-4f8c-4b04-8cb2-b22fe57b23b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c54c14f-e6a0-49c3-8d6a-90049fae9b29', 'volume_name': 'volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644d64dc-f264-4283-be2e-d99a3e23cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644d64dc-f264-4283-be2e-d99a3e23cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376435b1-a386-40fc-ace8-2b627f03d4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:01 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Volume 2c54c14f-e6a0-49c3-8d6a-90049fae9b29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29', 'volume_size': 1} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1041544205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c54c14f-e6a0-49c3-8d6a-90049fae9b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b33fc35196f4089ac5ded1a9ac84ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:01Z,use_quota=True,user_id='20508ad7a3a6432098be3ff2babd3367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cbf7d78-b713-4e7c-8a1e-a3bbec2acfe7),volume_type_id=0cbf7d78-b713-4e7c-8a1e-a3bbec2acfe7)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Creating volume 2c54c14f-e6a0-49c3-8d6a-90049fae9b29 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:01 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Acquiring lock "cinder-2d5659ff-52b3-414c-9cad-31e42120475a-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "cinder-2d5659ff-52b3-414c-9cad-31e42120475a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:01 devstack sudo[86025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29 1073741824 Apr 10 10:34:01 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Acquiring lock "cinder-quobyte-2d5659ff-52b3-414c-9cad-31e42120475a" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "cinder-quobyte-2d5659ff-52b3-414c-9cad-31e42120475a" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1b5bce-b4f6-4b7e-bf0e-11b1f2c1be35]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:01 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a Apr 10 10:34:01 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:02 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a" returned: 0 in 0.976s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:02 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a Apr 10 10:34:02 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:03 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29 1073741824" returned: 0 in 1.880s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:03 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29 Apr 10 10:34:03 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:03 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2d5659ff-52b3-414c-9cad-31e42120475a" returned: 0 in 0.887s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "cinder-quobyte-2d5659ff-52b3-414c-9cad-31e42120475a" released by "delete_volume" :: held 1.993s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Created reservations ['bee2c35b-dfa0-4065-b83a-1458407c2fdf', '07b3b5df-dbbb-4690-9b63-dc1e1ebe82f0', '4423f843-fbb6-41af-8130-317495b73fbd', '2790a93e-e31f-4ec2-b79d-d145e7f00f30'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:03 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:34:03 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:03 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29" returned: 0 in 0.624s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] <== create_volume: return (2551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.555s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376435b1-a386-40fc-ace8-2b627f03d4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7694850-5539-4165-896d-7a7d981888d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:03 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Volume volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29 (2c54c14f-e6a0-49c3-8d6a-90049fae9b29): created successfully Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7694850-5539-4165-896d-7a7d981888d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Flow 'volume_create_manager' (4a386039-9e59-4739-a3a0-3ad76beab918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:03 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f40c9b18-df64-4026-9465-4a423d545a7a tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Created volume successfully. Apr 10 10:34:04 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.565s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:04 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Deleted volume successfully. Apr 10 10:34:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b69de33c-8683-43e0-ada6-15368a18ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-27855603 None] Lock "cinder-2d5659ff-52b3-414c-9cad-31e42120475a-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-839e0afb-7b85-4808-9d5d-bf3cc6543695 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-839e0afb-7b85-4808-9d5d-bf3cc6543695 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-839e0afb-7b85-4808-9d5d-bf3cc6543695 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-839e0afb-7b85-4808-9d5d-bf3cc6543695 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-839e0afb-7b85-4808-9d5d-bf3cc6543695 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-839e0afb-7b85-4808-9d5d-bf3cc6543695 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:04 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:34:04 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:05 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-839e0afb-7b85-4808-9d5d-bf3cc6543695 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.648s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:05 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-839e0afb-7b85-4808-9d5d-bf3cc6543695 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-839e0afb-7b85-4808-9d5d-bf3cc6543695 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Retype volume completed successfully. Apr 10 10:34:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Acquiring lock "cinder-2c54c14f-e6a0-49c3-8d6a-90049fae9b29-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "cinder-2c54c14f-e6a0-49c3-8d6a-90049fae9b29-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Acquiring lock "cinder-quobyte-2c54c14f-e6a0-49c3-8d6a-90049fae9b29" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "cinder-quobyte-2c54c14f-e6a0-49c3-8d6a-90049fae9b29" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:06 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4037a05-5a18-40ce-9c18-473dce43c691]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:06 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29 Apr 10 10:34:06 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:07 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29" returned: 0 in 0.846s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:07 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29 Apr 10 10:34:07 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Flow 'volume_create_manager' (22c31a2f-457a-426b-ac38-73914d4d2820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fee4c8-b4ab-42ad-b0e3-48ca414b7ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fee4c8-b4ab-42ad-b0e3-48ca414b7ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1743532614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb2ce88-87c2-45ee-a154-96578fb2346a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cdfb4fcd3e43d0ac3055fb340b4877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:07Z,use_quota=True,user_id='ad7a1841842a41149ae3151f676b7c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30121e6-0fe8-466d-915b-c304f8953d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30121e6-0fe8-466d-915b-c304f8953d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda8f013-4be7-493c-880a-b4bcdb853165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda8f013-4be7-493c-880a-b4bcdb853165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eb2ce88-87c2-45ee-a154-96578fb2346a', 'volume_name': 'volume-0eb2ce88-87c2-45ee-a154-96578fb2346a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae7928a-cfae-4d47-b82a-b369a8f1df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae7928a-cfae-4d47-b82a-b369a8f1df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720d5533-29b9-4628-b09f-4fa3b070fc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:07 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Volume 0eb2ce88-87c2-45ee-a154-96578fb2346a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eb2ce88-87c2-45ee-a154-96578fb2346a', 'volume_size': 1} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1743532614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb2ce88-87c2-45ee-a154-96578fb2346a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0cdfb4fcd3e43d0ac3055fb340b4877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:07Z,use_quota=True,user_id='ad7a1841842a41149ae3151f676b7c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Creating volume 0eb2ce88-87c2-45ee-a154-96578fb2346a {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:07 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:07 devstack sudo[86392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a 1073741824 Apr 10 10:34:07 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:07 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2c54c14f-e6a0-49c3-8d6a-90049fae9b29" returned: 0 in 0.488s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "cinder-quobyte-2c54c14f-e6a0-49c3-8d6a-90049fae9b29" released by "delete_volume" :: held 1.379s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:07 devstack cinder-volume[83037]: WARNING cinder.quota [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:07 devstack cinder-volume[83037]: WARNING cinder.quota [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Created reservations ['71642b9a-1261-4b58-8569-e2ff5e016675', '9dc84996-628c-423e-a21f-edc5791c929b', 'e5c57851-b102-41c3-a3f4-4816a69551c7', '2ab681ec-9b5f-48ea-85ef-b55c63418e20'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:07 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:34:07 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:07 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a 1073741824" returned: 0 in 0.724s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:08 devstack sudo[86400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a Apr 10 10:34:08 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:08 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.597s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:08 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Deleted volume successfully. Apr 10 10:34:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f468c427-1271-44a5-8ff3-1ccc33d4d7a3 tempest-VolumeRetypeWithoutMigrationTest-127655549 None] Lock "cinder-2c54c14f-e6a0-49c3-8d6a-90049fae9b29-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:08 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a" returned: 0 in 0.761s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720d5533-29b9-4628-b09f-4fa3b070fc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb2ce88-87c2-45ee-a154-96578fb2346a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4efe3c-0a56-4eee-b5fa-b43037c38a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:08 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Volume volume-0eb2ce88-87c2-45ee-a154-96578fb2346a (0eb2ce88-87c2-45ee-a154-96578fb2346a): created successfully Apr 10 10:34:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4efe3c-0a56-4eee-b5fa-b43037c38a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Flow 'volume_create_manager' (22c31a2f-457a-426b-ac38-73914d4d2820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-022982ac-f934-4318-8a00-7802ea93867f tempest-VolumesServicesTestJSON-253715840 None] Created volume successfully. Apr 10 10:34:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Acquiring lock "cinder-0eb2ce88-87c2-45ee-a154-96578fb2346a-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Lock "cinder-0eb2ce88-87c2-45ee-a154-96578fb2346a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Acquiring lock "cinder-quobyte-0eb2ce88-87c2-45ee-a154-96578fb2346a" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Lock "cinder-quobyte-0eb2ce88-87c2-45ee-a154-96578fb2346a" acquired by "delete_volume" :: waited 0.038s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:09 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[93529cf6-2fea-4727-bbea-937244f03920]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:09 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a Apr 10 10:34:09 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:10 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a" returned: 0 in 0.783s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:10 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a Apr 10 10:34:10 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:11 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0eb2ce88-87c2-45ee-a154-96578fb2346a" returned: 0 in 0.603s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Lock "cinder-quobyte-0eb2ce88-87c2-45ee-a154-96578fb2346a" released by "delete_volume" :: held 1.435s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:11 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Created reservations ['15fddff4-2bb0-4446-b5d7-fe511607ddd6', '53592da1-1702-436c-a7c0-c1f52014aedf', 'fc3f31cc-cb94-4c6b-8ea1-dd1159b61310', 'bea5adfa-c2d1-4b85-a5c5-f639b6eb33ac'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:11 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:34:11 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:12 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.853s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:12 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Deleted volume successfully. Apr 10 10:34:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1858b447-aa63-4f37-9c12-74f63a5ab8a9 tempest-VolumesServicesTestJSON-253715840 None] Lock "cinder-0eb2ce88-87c2-45ee-a154-96578fb2346a-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Flow 'volume_create_manager' (2fd5bfaf-419e-4ee5-8350-680671f58a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d8fafc-4af6-44af-8780-cf2dc97b7942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d8fafc-4af6-44af-8780-cf2dc97b7942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1339253324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362a462c-210b-42ef-a224-4d282f1331e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d09221712f4338a265fcc57044e0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:16Z,use_quota=True,user_id='c3aa682c677e4783868127b0dd763bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784e24d2-0254-4a3b-94cb-890f75bca667),volume_type_id=784e24d2-0254-4a3b-94cb-890f75bca667)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b5a671-5a4c-42a1-8065-32e7ab9b2f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b5a671-5a4c-42a1-8065-32e7ab9b2f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d17cbf6-09be-4331-97da-f3290606fa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d17cbf6-09be-4331-97da-f3290606fa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '362a462c-210b-42ef-a224-4d282f1331e1', 'volume_name': 'volume-362a462c-210b-42ef-a224-4d282f1331e1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ab2e04-798e-4292-9cc9-6aa5812f6079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ab2e04-798e-4292-9cc9-6aa5812f6079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fb67e7-75f2-47e8-be9c-a53205bf3396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:15 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Volume 362a462c-210b-42ef-a224-4d282f1331e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-362a462c-210b-42ef-a224-4d282f1331e1', 'volume_size': 1} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1339253324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=362a462c-210b-42ef-a224-4d282f1331e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d09221712f4338a265fcc57044e0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:16Z,use_quota=True,user_id='c3aa682c677e4783868127b0dd763bb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(784e24d2-0254-4a3b-94cb-890f75bca667),volume_type_id=784e24d2-0254-4a3b-94cb-890f75bca667)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Creating volume 362a462c-210b-42ef-a224-4d282f1331e1 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:15 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:34:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:15 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1 1073741824 Apr 10 10:34:15 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:16 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1 1073741824" returned: 0 in 0.759s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:16 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1 Apr 10 10:34:16 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:17 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1" returned: 0 in 0.790s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fb67e7-75f2-47e8-be9c-a53205bf3396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-362a462c-210b-42ef-a224-4d282f1331e1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60eefe15-8f61-419a-b770-312f6e7bb6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:17 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Volume volume-362a462c-210b-42ef-a224-4d282f1331e1 (362a462c-210b-42ef-a224-4d282f1331e1): created successfully Apr 10 10:34:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60eefe15-8f61-419a-b770-312f6e7bb6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Flow 'volume_create_manager' (2fd5bfaf-419e-4ee5-8350-680671f58a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f1498c4f-5e82-4f52-ace9-5014ef4712e0 tempest-VolumeTypesAccessTest-835097714 None] Created volume successfully. Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Acquiring lock "cinder-362a462c-210b-42ef-a224-4d282f1331e1-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Flow 'volume_create_manager' (88e46c35-ccb1-4914-9108-46472d682637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e346b7c-d5cf-4cea-a90b-da9cdb4524df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Lock "cinder-362a462c-210b-42ef-a224-4d282f1331e1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Acquiring lock "cinder-quobyte-362a462c-210b-42ef-a224-4d282f1331e1" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e346b7c-d5cf-4cea-a90b-da9cdb4524df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-150703625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee9dc1d-8637-437a-a009-6d7fcb609aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c80ba192fc4bd497d15d3caad40914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:18Z,use_quota=True,user_id='ed241908f7614b428e1bcbf51e42e538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322fa53f-e6c2-44fb-a838-bf3d0a7efdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322fa53f-e6c2-44fb-a838-bf3d0a7efdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394de1c5-d713-4b9a-9e45-58defad8c91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.image.glance [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Creating Keystone auth plugin from conf {{(pid=83037) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Lock "cinder-quobyte-362a462c-210b-42ef-a224-4d282f1331e1" acquired by "delete_volume" :: waited 0.068s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cc05a1-5ee1-420a-b5a6-91bc4060dbf5]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:18 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1 Apr 10 10:34:18 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394de1c5-d713-4b9a-9e45-58defad8c91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fee9dc1d-8637-437a-a009-6d7fcb609aaf', 'volume_name': 'volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5b3def-a9c9-4283-86e8-571b2b63c3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5b3def-a9c9-4283-86e8-571b2b63c3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86ed5d7-1b9d-4c5a-abb6-1ef5635fdb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:18 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Volume fee9dc1d-8637-437a-a009-6d7fcb609aaf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:34:18 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Trying to clone fee9dc1d-8637-437a-a009-6d7fcb609aaf from image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]). {{(pid=83037) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:34:19 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:34:19 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:34:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2826e6-1a60-4eb0-b386-787572525137]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:19 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1" returned: 0 in 1.028s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:19 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1 Apr 10 10:34:19 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:19 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD Apr 10 10:34:19 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:20 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-362a462c-210b-42ef-a224-4d282f1331e1" returned: 0 in 0.791s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Lock "cinder-quobyte-362a462c-210b-42ef-a224-4d282f1331e1" released by "delete_volume" :: held 1.870s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:20 devstack cinder-volume[83037]: WARNING cinder.quota [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1161937820 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1161937820, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:20 devstack cinder-volume[83037]: WARNING cinder.quota [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1161937820 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1161937820, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Created reservations ['a011a870-1ec0-4bc3-a812-f2ac06f0e84e', 'e1dac2c7-6853-476c-8c5c-15dbf25a3185', '7ae60168-9af3-4211-862d-e8fd715c16d3', '5de16043-f103-4c53-aae3-d179c04f1629'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:20 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD" returned: 0 in 1.048s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Temporary image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df is fetched for user ed241908f7614b428e1bcbf51e42e538. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:20 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:34:20 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a532c-80d6-4e51-a07c-3142ccd4b098]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:20 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD Apr 10 10:34:20 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:21 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD" returned: 0 in 1.009s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-150703625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee9dc1d-8637-437a-a009-6d7fcb609aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1c80ba192fc4bd497d15d3caad40914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:18Z,use_quota=True,user_id='ed241908f7614b428e1bcbf51e42e538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Creating volume fee9dc1d-8637-437a-a009-6d7fcb609aaf {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:21 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:21 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 1.120s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Deleted volume successfully. Apr 10 10:34:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bffb3eb0-bf44-45d3-b71c-9b2464427bc7 tempest-VolumeTypesAccessTest-835097714 None] Lock "cinder-362a462c-210b-42ef-a224-4d282f1331e1-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:21 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf 1073741824 Apr 10 10:34:21 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:22 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf 1073741824" returned: 0 in 0.940s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:22 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf Apr 10 10:34:22 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:23 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf" returned: 0 in 0.753s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:23 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Attempting download of d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df ((None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}])) to volume fee9dc1d-8637-437a-a009-6d7fcb609aaf. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:34:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b704d15-bc86-4ac6-b47c-32c1d8f5d5ce]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_k0i1mkfm {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:23 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_k0i1mkfm Apr 10 10:34:23 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:24 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_k0i1mkfm" returned: 0 in 0.809s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_k0i1mkfm {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:24 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_k0i1mkfm Apr 10 10:34:24 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:24 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_k0i1mkfm" returned: 1 in 0.781s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_k0i1mkfm' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:34:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbea6709-11ac-4c4e-9559-ae3e9036f016]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:24 devstack sudo[86628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD Apr 10 10:34:24 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:25 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD" returned: 0 in 0.696s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:25 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df was qcow2, converting to raw {{(pid=83037) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:34:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:25 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf Apr 10 10:34:25 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:27 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf" returned: 0 in 1.547s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_ncjukr_pdevstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:34:27 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Converted 112.00 MB image at 72.26 MB/s Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:27 devstack sudo[86641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf 1G Apr 10 10:34:27 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Flow 'volume_create_manager' (56f9a6b7-21b3-4582-955a-e597c8b284e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd827071-6bad-4d2f-aeb8-bf0f6532fb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd827071-6bad-4d2f-aeb8-bf0f6532fb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-793876050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892eccd5-9ad6-4c8c-8964-d26f8c066be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb0e2df84804456aa111928d4bec784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:28Z,use_quota=True,user_id='d18e53c834fe4a718cdcf29b04af7fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4509f7-740f-4987-90bc-a94a3932d0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4509f7-740f-4987-90bc-a94a3932d0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f29c37-46a9-4e93-b37e-c7f440e98ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f29c37-46a9-4e93-b37e-c7f440e98ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '892eccd5-9ad6-4c8c-8964-d26f8c066be5', 'volume_name': 'volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be45022d-9d65-4692-8bee-f50329fd8e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be45022d-9d65-4692-8bee-f50329fd8e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc87d3a-3369-4185-8f2b-b93cfc7f33be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:27 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Volume 892eccd5-9ad6-4c8c-8964-d26f8c066be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5', 'volume_size': 1} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-793876050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892eccd5-9ad6-4c8c-8964-d26f8c066be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb0e2df84804456aa111928d4bec784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:28Z,use_quota=True,user_id='d18e53c834fe4a718cdcf29b04af7fbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Creating volume 892eccd5-9ad6-4c8c-8964-d26f8c066be5 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:27 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:27 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 1073741824 Apr 10 10:34:27 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:27 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf 1G" returned: 0 in 0.775s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaae196-cfea-4893-9b59-2c2928ead57d]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:27 devstack sudo[86648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf Apr 10 10:34:27 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:28 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 1073741824" returned: 0 in 0.787s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:28 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 Apr 10 10:34:28 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:28 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf" returned: 0 in 0.866s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:28 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf Apr 10 10:34:28 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:29 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5" returned: 0 in 0.660s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc87d3a-3369-4185-8f2b-b93cfc7f33be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7ceccc-2bde-4264-a7d3-020b17459523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:29 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Volume volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 (892eccd5-9ad6-4c8c-8964-d26f8c066be5): created successfully Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7ceccc-2bde-4264-a7d3-020b17459523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Flow 'volume_create_manager' (56f9a6b7-21b3-4582-955a-e597c8b284e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-00d0ccf7-2c43-4b67-be7f-6eed01836f19 tempest-SnapshotMetadataTestJSON-1475270120 None] Created volume successfully. Apr 10 10:34:29 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf" returned: 1 in 0.730s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Downloaded image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df ((None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}])) to volume fee9dc1d-8637-437a-a009-6d7fcb609aaf successfully. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Temporary image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df for user ed241908f7614b428e1bcbf51e42e538 is deleted. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Marking volume fee9dc1d-8637-437a-a009-6d7fcb609aaf as bootable. {{(pid=83037) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Copying metadata from image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df to fee9dc1d-8637-437a-a009-6d7fcb609aaf. {{(pid=83037) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Creating volume glance metadata for volume fee9dc1d-8637-437a-a009-6d7fcb609aaf backed by image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83037) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86ed5d7-1b9d-4c5a-abb6-1ef5635fdb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c055fe2c-7918-41fb-af89-19ae1133e3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:29 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Volume volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf (fee9dc1d-8637-437a-a009-6d7fcb609aaf): created successfully Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c055fe2c-7918-41fb-af89-19ae1133e3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Flow 'volume_create_manager' (88e46c35-ccb1-4914-9108-46472d682637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4a822de1-0379-4376-890b-b245d712d34d tempest-VolumesImageMetadata-1950137647 None] Created volume successfully. Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] Creating offline snapshot 35e8edf8-f707-4c6d-9801-0fb2261d3b1b of volume 892eccd5-9ad6-4c8c-8964-d26f8c066be5 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:30 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c4bbe9-8c2a-475d-9608-5af8219ed036]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:30 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 Apr 10 10:34:30 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Acquiring lock "cinder-fee9dc1d-8637-437a-a009-6d7fcb609aaf-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Lock "cinder-fee9dc1d-8637-437a-a009-6d7fcb609aaf-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Acquiring lock "cinder-quobyte-fee9dc1d-8637-437a-a009-6d7fcb609aaf" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Lock "cinder-quobyte-fee9dc1d-8637-437a-a009-6d7fcb609aaf" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:30 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b66212-0fd9-4e34-9ea9-bb129968f207]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:30 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf Apr 10 10:34:30 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:30 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5" returned: 0 in 0.711s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:30 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b 1G Apr 10 10:34:30 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:31 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf" returned: 0 in 0.675s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:31 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf Apr 10 10:34:31 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:31 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b 1G" returned: 0 in 0.730s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:31 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b Apr 10 10:34:31 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:31 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf" returned: 1 in 0.776s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:34:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:31 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf Apr 10 10:34:31 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:32 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b" returned: 0 in 0.857s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:32 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b is being set with open permissions: ugo+rw Apr 10 10:34:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:32 devstack sudo[86724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b Apr 10 10:34:32 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:32 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fee9dc1d-8637-437a-a009-6d7fcb609aaf" returned: 0 in 0.720s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Lock "cinder-quobyte-fee9dc1d-8637-437a-a009-6d7fcb609aaf" released by "delete_volume" :: held 2.234s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:32 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Created reservations ['c276f7be-6d21-4565-b321-30397b8d4a36', 'eb4d2fd1-78be-466d-98de-77d8b58de288', 'bbf68bc0-7eee-4e02-ad36-c606b8df4a40', '143ae97d-3e63-4f52-9842-d943b6938dd0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:32 devstack sudo[86727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:34:32 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:33 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b" returned: 0 in 0.714s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:33 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.info Apr 10 10:34:33 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:33 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.708s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:33 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Deleted volume successfully. Apr 10 10:34:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-60cc16f5-928c-4136-b11e-aa9cfb5b9e56 tempest-VolumesImageMetadata-1950137647 None] Lock "cinder-fee9dc1d-8637-437a-a009-6d7fcb609aaf-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:33 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.info" returned: 0 in 0.744s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:33 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.info is being set with open permissions: ugo+rw Apr 10 10:34:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:33 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.info Apr 10 10:34:33 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:34 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.info" returned: 0 in 0.789s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.646s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:34 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-97326db3-b3ef-4141-ab75-7be7e44e0464 tempest-SnapshotMetadataTestJSON-1475270120 None] Create snapshot completed successfully Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Acquiring lock "cinder-35e8edf8-f707-4c6d-9801-0fb2261d3b1b-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "cinder-35e8edf8-f707-4c6d-9801-0fb2261d3b1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Acquiring lock "cinder-quobyte-892eccd5-9ad6-4c8c-8964-d26f8c066be5" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "cinder-quobyte-892eccd5-9ad6-4c8c-8964-d26f8c066be5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Acquiring lock "cinder-quobyte-35e8edf8-f707-4c6d-9801-0fb2261d3b1b" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "cinder-quobyte-35e8edf8-f707-4c6d-9801-0fb2261d3b1b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Deleting offline snapshot 35e8edf8-f707-4c6d-9801-0fb2261d3b1b of volume 892eccd5-9ad6-4c8c-8964-d26f8c066be5 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] snapshot_file for this snap is: volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[839a459c-09fb-4850-9ed9-e7ef1e81d607]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:36 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b Apr 10 10:34:36 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:36 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b" returned: 0 in 0.829s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa85415-2a18-446a-9cbe-e0d6f287b99a]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:37 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 Apr 10 10:34:37 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:37 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5" returned: 0 in 0.781s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:37 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b Apr 10 10:34:37 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:38 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b" returned: 0 in 0.761s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:38 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b Apr 10 10:34:38 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Flow 'volume_create_manager' (0d99133e-d642-4a9f-9373-bd7bb7a3ba2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7052abb6-4ebe-4d65-a878-d914993c8946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7052abb6-4ebe-4d65-a878-d914993c8946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-721730542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959c54cb40324bed841f5c4214670971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:39Z,use_quota=True,user_id='ff5a9d78b94b4ce9b4e29dcd90d088a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014f3ea2-215c-4963-80c6-6759d9c627a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014f3ea2-215c-4963-80c6-6759d9c627a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c62136-9ff4-479a-ba6c-2da45fa9edf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22c62136-9ff4-479a-ba6c-2da45fa9edf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7', 'volume_name': 'volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb014625-79f1-4228-971f-8a6a639937b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb014625-79f1-4228-971f-8a6a639937b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4e2f61-aff0-4098-98d6-e53305e83d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:38 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Volume 4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7', 'volume_size': 1} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-721730542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959c54cb40324bed841f5c4214670971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:39Z,use_quota=True,user_id='ff5a9d78b94b4ce9b4e29dcd90d088a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Creating volume 4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:38 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:34:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:38 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7 1073741824 Apr 10 10:34:38 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:39 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5.35e8edf8-f707-4c6d-9801-0fb2261d3b1b" returned: 0 in 0.627s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "cinder-quobyte-35e8edf8-f707-4c6d-9801-0fb2261d3b1b" released by "_delete_snapshot" :: held 3.101s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "cinder-quobyte-892eccd5-9ad6-4c8c-8964-d26f8c066be5" released by "delete_snapshot" :: held 3.126s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:39 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Created reservations ['ad491082-7820-42af-82e8-a6e99b196431', '27fd6580-54d6-4217-bb6e-a65ee96f6343', '0fc332f8-3a09-4ac6-a98f-3d2fc3d13097', 'cfa046f9-b967-45a7-9a9f-8934b3d0da3e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Delete snapshot completed successfully. Apr 10 10:34:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0612a566-45f0-43bb-b58c-9ca6ea6a401d tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "cinder-35e8edf8-f707-4c6d-9801-0fb2261d3b1b-delete_snapshot" released by "delete_snapshot" :: held 3.300s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:39 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7 1073741824" returned: 0 in 0.730s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:39 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7 Apr 10 10:34:39 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:40 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7" returned: 0 in 0.740s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e4e2f61-aff0-4098-98d6-e53305e83d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e3a1e4-1a37-4cb6-a599-9123c4e8579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Volume volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7 (4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7): created successfully Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e3a1e4-1a37-4cb6-a599-9123c4e8579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Flow 'volume_create_manager' (0d99133e-d642-4a9f-9373-bd7bb7a3ba2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:40 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2aa30b7b-651b-47b4-9948-c07d3df5350c tempest-VolumesTransfersTest-438482142 None] Created volume successfully. Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Acquiring lock "cinder-892eccd5-9ad6-4c8c-8964-d26f8c066be5-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "cinder-892eccd5-9ad6-4c8c-8964-d26f8c066be5-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Flow 'volume_create_manager' (1dd13622-6c5b-4f4c-b73c-91a3a75b89ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17860436-dad2-4f0d-a980-4d6a8b4c9ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17860436-dad2-4f0d-a980-4d6a8b4c9ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1788941147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3040f16-595f-48c6-88cd-3fa5499ba5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb75ee0df0f4cacb23682589043c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:41Z,use_quota=True,user_id='100f4be5ed6149a7b67672423e3af4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641cd4a4-3592-4002-9e4d-e9b075cd3286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641cd4a4-3592-4002-9e4d-e9b075cd3286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06351b4f-b67f-4efd-9c00-eb8c9551526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06351b4f-b67f-4efd-9c00-eb8c9551526e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3040f16-595f-48c6-88cd-3fa5499ba5ca', 'volume_name': 'volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf915f77-ddbe-4112-bdf8-93462b8b95f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf915f77-ddbe-4112-bdf8-93462b8b95f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fdb2e2-163b-4ab3-a5dd-2d21e67b23bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Volume b3040f16-595f-48c6-88cd-3fa5499ba5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca', 'volume_size': 1} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1788941147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3040f16-595f-48c6-88cd-3fa5499ba5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb75ee0df0f4cacb23682589043c81b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:41Z,use_quota=True,user_id='100f4be5ed6149a7b67672423e3af4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Creating volume b3040f16-595f-48c6-88cd-3fa5499ba5ca {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:40 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Acquiring lock "cinder-quobyte-892eccd5-9ad6-4c8c-8964-d26f8c066be5" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:41 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca 1073741824 Apr 10 10:34:41 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "cinder-quobyte-892eccd5-9ad6-4c8c-8964-d26f8c066be5" acquired by "delete_volume" :: waited 0.036s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:41 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[143917b6-a8fa-44fb-93e0-5c5b6aa5c2bd]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:41 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 Apr 10 10:34:41 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:41 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:41 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-609dc735-ca4d-414b-9d33-7f766d596335 tempest-VolumesTransfersTest-1622253422 None] Transfer volume completed successfully. Apr 10 10:34:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5" returned: 0 in 0.845s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:41 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5 Apr 10 10:34:41 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:42 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca 1073741824" returned: 0 in 1.198s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:42 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca Apr 10 10:34:42 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:42 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-892eccd5-9ad6-4c8c-8964-d26f8c066be5" returned: 0 in 0.620s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "cinder-quobyte-892eccd5-9ad6-4c8c-8964-d26f8c066be5" released by "delete_volume" :: held 1.581s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:42 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Created reservations ['5909e002-603f-4098-bfd0-9f8aa172be27', '25a99847-5991-43d6-9235-ad3dc10f429f', 'ae8e5929-155d-4e2b-be04-7b5fcce37ed4', '39394c64-ee4a-4d35-b0ed-c304c408da0a'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:42 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:34:42 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:43 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca" returned: 0 in 0.827s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fdb2e2-163b-4ab3-a5dd-2d21e67b23bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878da7b3-b79f-4a38-9d00-fae4f9da61b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Acquiring lock "cinder-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:43 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Volume volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca (b3040f16-595f-48c6-88cd-3fa5499ba5ca): created successfully Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878da7b3-b79f-4a38-9d00-fae4f9da61b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Flow 'volume_create_manager' (1dd13622-6c5b-4f4c-b73c-91a3a75b89ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a38eb2f1-2579-48fa-9437-8d8ce8662d3e tempest-VolumesActionsTest-200790162 None] Created volume successfully. Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Lock "cinder-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Acquiring lock "cinder-quobyte-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Lock "cinder-quobyte-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b3dde5-75ac-4446-8d26-b1845564112e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:43 devstack sudo[86830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7 Apr 10 10:34:43 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:43 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.779s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Deleted volume successfully. Apr 10 10:34:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1d378e2b-57f1-4f03-870f-8cc2d449097a tempest-SnapshotMetadataTestJSON-1475270120 None] Lock "cinder-892eccd5-9ad6-4c8c-8964-d26f8c066be5-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:44 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7" returned: 0 in 0.982s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:44 devstack sudo[86836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7 Apr 10 10:34:44 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:45 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7" returned: 0 in 0.968s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Lock "cinder-quobyte-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7" released by "delete_volume" :: held 2.049s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:45 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Created reservations ['83a42890-df5e-4d1e-bed3-ce0bf99b432a', '73f5cd24-03aa-4fbb-9ff1-e59b3c5e1111', '5ddbd2f2-0ae6-4c6e-984b-209c86857170', '0eb90852-edf4-45e0-afe7-a160af15bf62'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:45 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:34:45 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:46 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.647s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Deleted volume successfully. Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-71310ec5-3791-4ea2-86ed-9612af492b3c tempest-VolumesTransfersTest-918627182 None] Lock "cinder-4f4b6fbc-a3ee-459a-b48f-ae9f5e930cd7-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Flow 'volume_create_manager' (530e455b-a9b7-4870-a191-189b34a3ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd0161f-d804-44a8-85af-ffac916cfb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bd0161f-d804-44a8-85af-ffac916cfb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1153746007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b971700a-c299-4b47-9e76-168708a548a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d091321724403391f9d9c191a803fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:46Z,use_quota=True,user_id='f4e7b6e0bdd248e58de0c7e27f888841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dae6527-efec-4485-92a0-081f68e5ec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dae6527-efec-4485-92a0-081f68e5ec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b90b72-675c-40e2-95cc-2c7aa54999ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b90b72-675c-40e2-95cc-2c7aa54999ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b971700a-c299-4b47-9e76-168708a548a5', 'volume_name': 'volume-b971700a-c299-4b47-9e76-168708a548a5', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97548423-bb73-460c-ba3e-581640fc49d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97548423-bb73-460c-ba3e-581640fc49d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7aa93ff-0ec8-4255-b3c2-b33e841ff94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Volume b971700a-c299-4b47-9e76-168708a548a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b971700a-c299-4b47-9e76-168708a548a5', 'volume_size': 1} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1153746007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b971700a-c299-4b47-9e76-168708a548a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d091321724403391f9d9c191a803fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:46Z,use_quota=True,user_id='f4e7b6e0bdd248e58de0c7e27f888841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Creating volume b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:46 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:46 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 1073741824 Apr 10 10:34:46 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:46 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Flow 'volume_create_manager' (7cd7270f-198d-4b46-a782-cc8aa9c72338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7856f3a7-bb4c-4de5-9058-75072d692bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7856f3a7-bb4c-4de5-9058-75072d692bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-729089666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76501fb1-ca3b-4a8e-95df-97fb9b5a954e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959c54cb40324bed841f5c4214670971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:47Z,use_quota=True,user_id='ff5a9d78b94b4ce9b4e29dcd90d088a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302ebdea-44cd-41a2-b834-7d2336069985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302ebdea-44cd-41a2-b834-7d2336069985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d0021f-237a-43cd-9727-2b685d4baf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d0021f-237a-43cd-9727-2b685d4baf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76501fb1-ca3b-4a8e-95df-97fb9b5a954e', 'volume_name': 'volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdec3033-3af2-42f8-a394-b5a26d95db48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdec3033-3af2-42f8-a394-b5a26d95db48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450a7d57-78c5-42cc-b672-9d617fb462da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:47 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Volume 76501fb1-ca3b-4a8e-95df-97fb9b5a954e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e', 'volume_size': 1} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:47 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 1073741824" returned: 0 in 0.733s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:47 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 Apr 10 10:34:47 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:47 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5" returned: 0 in 0.598s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.853s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-729089666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76501fb1-ca3b-4a8e-95df-97fb9b5a954e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959c54cb40324bed841f5c4214670971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:47Z,use_quota=True,user_id='ff5a9d78b94b4ce9b4e29dcd90d088a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Creating volume 76501fb1-ca3b-4a8e-95df-97fb9b5a954e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:47 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7aa93ff-0ec8-4255-b3c2-b33e841ff94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b971700a-c299-4b47-9e76-168708a548a5', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be589323-4d03-49be-9c7e-d5333b137413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:47 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Volume volume-b971700a-c299-4b47-9e76-168708a548a5 (b971700a-c299-4b47-9e76-168708a548a5): created successfully Apr 10 10:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be589323-4d03-49be-9c7e-d5333b137413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Flow 'volume_create_manager' (530e455b-a9b7-4870-a191-189b34a3ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:48 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e 1073741824 Apr 10 10:34:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f2ebf663-3457-448d-8eaa-980c8b13d271 tempest-VolumesDeleteCascade-1987215380 None] Created volume successfully. Apr 10 10:34:48 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:48 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e 1073741824" returned: 0 in 0.715s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:48 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e Apr 10 10:34:48 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:49 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e" returned: 0 in 0.567s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.444s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450a7d57-78c5-42cc-b672-9d617fb462da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1945b668-7e81-42d8-a409-3b0f0d1ca92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] Creating offline snapshot 3f26900f-cdb3-4a9e-8aa5-b07971943848 of volume b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:49 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Volume volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e (76501fb1-ca3b-4a8e-95df-97fb9b5a954e): created successfully Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1945b668-7e81-42d8-a409-3b0f0d1ca92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Flow 'volume_create_manager' (7cd7270f-198d-4b46-a782-cc8aa9c72338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[645bbfeb-2b9c-497d-aca9-e54b97f78b97]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:49 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-499fd496-baa7-4a3d-ab96-e23490be0c15 tempest-VolumesTransfersTest-438482142 None] Created volume successfully. Apr 10 10:34:49 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 Apr 10 10:34:49 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:49 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5" returned: 0 in 0.647s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:49 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 1G Apr 10 10:34:49 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Acquiring lock "cinder-76501fb1-ca3b-4a8e-95df-97fb9b5a954e-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Lock "cinder-76501fb1-ca3b-4a8e-95df-97fb9b5a954e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:50 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=102,cinder:DELETE=12,cinder:UPDATE=89,cinder:INSERT=27 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:34:50 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=99,cinder:INSERT=35,cinder:UPDATE=134,cinder:DELETE=7 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:34:50 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 1G" returned: 0 in 0.877s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Acquiring lock "cinder-quobyte-76501fb1-ca3b-4a8e-95df-97fb9b5a954e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971700a-c299-4b47-9e76-168708a548a5 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Lock "cinder-quobyte-76501fb1-ca3b-4a8e-95df-97fb9b5a954e" acquired by "delete_volume" :: waited 0.039s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:50 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971700a-c299-4b47-9e76-168708a548a5 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 Apr 10 10:34:50 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:50 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa6bd43-af9c-4718-9041-02bbf26cef3b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:51 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e Apr 10 10:34:51 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:51 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971700a-c299-4b47-9e76-168708a548a5 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848" returned: 0 in 0.731s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:51 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 is being set with open permissions: ugo+rw Apr 10 10:34:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:51 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 Apr 10 10:34:51 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:51 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e" returned: 0 in 1.031s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:51 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e Apr 10 10:34:51 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:52 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848" returned: 0 in 1.194s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:52 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-76501fb1-ca3b-4a8e-95df-97fb9b5a954e" returned: 0 in 0.941s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:52 devstack sudo[86920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.info Apr 10 10:34:52 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Lock "cinder-quobyte-76501fb1-ca3b-4a8e-95df-97fb9b5a954e" released by "delete_volume" :: held 2.013s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:52 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Created reservations ['ee2ddf43-48cb-494a-849f-6ec0181ee00b', 'c54d10f0-ccbd-4dd0-8473-03801b3d4d35', 'a20a1f28-667b-479d-8801-86901e6c1b5a', '201687ae-e6cc-4d50-9c2d-33a867681004'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:53 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:34:53 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:53 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.info" returned: 0 in 0.818s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:53 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.info is being set with open permissions: ugo+rw Apr 10 10:34:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:53 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.info Apr 10 10:34:53 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:54 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.896s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:54 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Deleted volume successfully. Apr 10 10:34:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d37a91cc-6709-4c27-a53e-7a645e783241 tempest-VolumesTransfersTest-918627182 None] Lock "cinder-76501fb1-ca3b-4a8e-95df-97fb9b5a954e-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:54 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.info" returned: 0 in 0.890s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.313s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0b47a20a-ff68-4628-b41e-2c184720b2e0 tempest-VolumesDeleteCascade-1987215380 None] Create snapshot completed successfully Apr 10 10:34:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] Creating offline snapshot 61f3dbc1-f4da-484b-88e4-9527501290de of volume b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[629a3797-cf99-4776-98d0-eef7b052396f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:55 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 Apr 10 10:34:55 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:56 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848" returned: 0 in 0.831s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b971700a-c299-4b47-9e76-168708a548a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:56 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de 1G Apr 10 10:34:56 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:57 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de 1G" returned: 0 in 0.889s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:57 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de Apr 10 10:34:57 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:57 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:34:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:57 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:34:57 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:58 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de" returned: 0 in 0.622s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:58 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de is being set with open permissions: ugo+rw Apr 10 10:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:58 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de Apr 10 10:34:58 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:58 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.870s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:59 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de" returned: 0 in 1.048s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.571s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3cc42f56-71ff-455c-aba3-3ff3b835fb6e tempest-VolumesDeleteCascade-1987215380 None] Create snapshot completed successfully Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-b971700a-c299-4b47-9e76-168708a548a5-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-b971700a-c299-4b47-9e76-168708a548a5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Performing cascade delete. {{(pid=83037) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-3f26900f-cdb3-4a9e-8aa5-b07971943848-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-3f26900f-cdb3-4a9e-8aa5-b07971943848-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-quobyte-b971700a-c299-4b47-9e76-168708a548a5" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-b971700a-c299-4b47-9e76-168708a548a5" acquired by "delete_snapshot" :: waited 0.044s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-quobyte-3f26900f-cdb3-4a9e-8aa5-b07971943848" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-3f26900f-cdb3-4a9e-8aa5-b07971943848" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Deleting offline snapshot 3f26900f-cdb3-4a9e-8aa5-b07971943848 of volume b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] snapshot_file for this snap is: volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[03330d61-a710-4989-ad3c-ce95987d2d81]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:00 devstack sudo[87004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 Apr 10 10:35:00 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:01 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Flow 'volume_create_manager' (5245b54a-9cf4-4b1a-98fa-fa3b3d2bbba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bd664e-10b1-43fc-b098-9373c562809d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-43cba52d-1b16-417c-996e-315360a31bc6 tempest-VolumesActionsTest-200790162 None] Acquiring lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca" by "attach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bd664e-10b1-43fc-b098-9373c562809d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:01Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ad65ee-ea0b-43bd-834b-d409fc88650d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cce5ef1286c45ee9bf9c0ca25acac2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:01Z,use_quota=True,user_id='30499ce0e33745ec93a93e68d060fda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681ab235-b62a-4b6e-a11a-71dced9a3125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (681ab235-b62a-4b6e-a11a-71dced9a3125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe1ef62-2f17-44b6-8b76-d852ebca1c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:01 devstack cinder-volume[83037]: DEBUG cinder.image.glance [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Creating Keystone auth plugin from conf {{(pid=83037) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:35:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-43cba52d-1b16-417c-996e-315360a31bc6 tempest-VolumesActionsTest-200790162 None] Lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca" acquired by "attach_volume" :: waited 0.133s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:02 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-43cba52d-1b16-417c-996e-315360a31bc6 tempest-VolumesActionsTest-200790162 None] Attaching volume b3040f16-595f-48c6-88cd-3fa5499ba5ca to instance 54021ce7-e3be-4245-bf5d-fc594a31d36b at mountpoint /dev/vdb on host None. Apr 10 10:35:02 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-43cba52d-1b16-417c-996e-315360a31bc6 tempest-VolumesActionsTest-200790162 None] Attach volume completed successfully. Apr 10 10:35:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-43cba52d-1b16-417c-996e-315360a31bc6 tempest-VolumesActionsTest-200790162 None] Lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca" released by "attach_volume" :: held 0.375s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe1ef62-2f17-44b6-8b76-d852ebca1c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5ad65ee-ea0b-43bd-834b-d409fc88650d', 'volume_name': 'volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e785842-cc0d-465f-92dc-53a05732ebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e785842-cc0d-465f-92dc-53a05732ebbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f5d2e3-a2d6-4d24-ba8a-87f718415ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:02 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Volume c5ad65ee-ea0b-43bd-834b-d409fc88650d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:35:02 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Trying to clone c5ad65ee-ea0b-43bd-834b-d409fc88650d from image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]). {{(pid=83037) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:35:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6f746253-ae9c-4a15-ad63-e4e0c66e75c0 tempest-VolumesActionsTest-200790162 None] Acquiring lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca-detach_volume" by "detach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:03 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848" returned: 0 in 2.398s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b971700a-c299-4b47-9e76-168708a548a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6f746253-ae9c-4a15-ad63-e4e0c66e75c0 tempest-VolumesActionsTest-200790162 None] Lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca-detach_volume" acquired by "detach_volume" :: waited 0.143s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:03 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6f746253-ae9c-4a15-ad63-e4e0c66e75c0 tempest-VolumesActionsTest-200790162 None] Detaching volume b3040f16-595f-48c6-88cd-3fa5499ba5ca from instance 54021ce7-e3be-4245-bf5d-fc594a31d36b. Apr 10 10:35:03 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c203f019-3785-400e-b811-73b6cc94a728]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:03 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6f746253-ae9c-4a15-ad63-e4e0c66e75c0 tempest-VolumesActionsTest-200790162 None] Detach volume completed successfully. Apr 10 10:35:03 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 Apr 10 10:35:03 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-6f746253-ae9c-4a15-ad63-e4e0c66e75c0 tempest-VolumesActionsTest-200790162 None] Lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca-detach_volume" released by "detach_volume" :: held 0.394s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:03 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:35:03 devstack cinder-volume[83037]: INFO cinder.image.image_utils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:35:03 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fa0048-645c-431b-9e4f-78536c5277a3]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:04 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD Apr 10 10:35:04 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Flow 'volume_create_manager' (2e67d919-ae4d-401f-972e-4a4a243d8e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc88110-a8cd-4ddd-b135-b506b76436c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc88110-a8cd-4ddd-b135-b506b76436c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1472715611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3523f810-01b8-4d94-8001-1b54b09915d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f54f94a8d4cf19e6ffbb8f4d45210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:05Z,use_quota=True,user_id='8d466a41bcd94dc891bd109eb89a0f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253b0395-c16c-47e1-b9f9-2863417ecde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253b0395-c16c-47e1-b9f9-2863417ecde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146d3570-0a57-40d1-a00c-a916850a45ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146d3570-0a57-40d1-a00c-a916850a45ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3523f810-01b8-4d94-8001-1b54b09915d8', 'volume_name': 'volume-3523f810-01b8-4d94-8001-1b54b09915d8', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e89124a-2349-4e0e-b831-53bec2bb5443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e89124a-2349-4e0e-b831-53bec2bb5443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d8973b-27a2-41a7-916a-46bdd3c5cfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:05 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Volume 3523f810-01b8-4d94-8001-1b54b09915d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3523f810-01b8-4d94-8001-1b54b09915d8', 'volume_size': 1} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1472715611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3523f810-01b8-4d94-8001-1b54b09915d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f54f94a8d4cf19e6ffbb8f4d45210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:05Z,use_quota=True,user_id='8d466a41bcd94dc891bd109eb89a0f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Creating volume 3523f810-01b8-4d94-8001-1b54b09915d8 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:05 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:05 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8 1073741824 Apr 10 10:35:05 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:05 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5" returned: 0 in 2.327s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:05 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD" returned: 0 in 1.885s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Temporary image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df is fetched for user 30499ce0e33745ec93a93e68d060fda0. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee871b2-7c93-4c4a-83da-574310b1ea79]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cb802c-d8ef-46ee-9001-e0c23008d02f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:06 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de Apr 10 10:35:06 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:06 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD Apr 10 10:35:06 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:06 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8 1073741824" returned: 0 in 1.554s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:06 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8 Apr 10 10:35:06 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:07 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de" returned: 0 in 1.413s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b971700a-c299-4b47-9e76-168708a548a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:07 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD" returned: 0 in 1.315s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[00caba64-6478-44fd-8174-c44e1fa8d94d]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:07 devstack sudo[87085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 Apr 10 10:35:07 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:07 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8" returned: 0 in 0.875s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] <== create_volume: return (2522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.532s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.626s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:01Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ad65ee-ea0b-43bd-834b-d409fc88650d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cce5ef1286c45ee9bf9c0ca25acac2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:01Z,use_quota=True,user_id='30499ce0e33745ec93a93e68d060fda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Creating volume c5ad65ee-ea0b-43bd-834b-d409fc88650d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:07 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d8973b-27a2-41a7-916a-46bdd3c5cfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3523f810-01b8-4d94-8001-1b54b09915d8', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c018ab39-cf26-459d-b555-5c9f215570b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:07 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d 1073741824 Apr 10 10:35:07 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:07 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Volume volume-3523f810-01b8-4d94-8001-1b54b09915d8 (3523f810-01b8-4d94-8001-1b54b09915d8): created successfully Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c018ab39-cf26-459d-b555-5c9f215570b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Flow 'volume_create_manager' (2e67d919-ae4d-401f-972e-4a4a243d8e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2958e975-3a16-4333-a921-5ec66a36bd92 tempest-VolumesTransfersV355Test-892513834 None] Created volume successfully. Apr 10 10:35:08 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848" returned: 0 in 0.848s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b971700a-c299-4b47-9e76-168708a548a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:08 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7403ebef-ddeb-4925-89fa-7c31064b2321]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:08 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 Apr 10 10:35:08 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:08 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d 1073741824" returned: 0 in 0.807s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:08 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d Apr 10 10:35:08 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:08 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5" returned: 0 in 0.791s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:08 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 Apr 10 10:35:08 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-67af1be3-4702-4216-9a44-83bc0b00be81 tempest-VolumesTransfersV355Test-553167135 None] Transfer volume completed successfully. Apr 10 10:35:09 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d" returned: 0 in 0.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:09 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Attempting download of d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df ((None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}])) to volume c5ad65ee-ea0b-43bd-834b-d409fc88650d. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:35:09 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a49da1-2a31-4279-a915-ad74a16307b2]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_l_3jkf80 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:09 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_l_3jkf80 Apr 10 10:35:09 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:09 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848" returned: 0 in 0.733s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:09 devstack sudo[87120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848 Apr 10 10:35:09 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Acquiring lock "cinder-3523f810-01b8-4d94-8001-1b54b09915d8-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Lock "cinder-3523f810-01b8-4d94-8001-1b54b09915d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:10 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_l_3jkf80" returned: 0 in 0.787s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_l_3jkf80 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Acquiring lock "cinder-quobyte-3523f810-01b8-4d94-8001-1b54b09915d8" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Lock "cinder-quobyte-3523f810-01b8-4d94-8001-1b54b09915d8" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e7a59e-5fd0-4114-bbca-1f03b0cda17a]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:10 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_l_3jkf80 Apr 10 10:35:10 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:10 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.3f26900f-cdb3-4a9e-8aa5-b07971943848" returned: 0 in 0.686s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971700a-c299-4b47-9e76-168708a548a5 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de -F qcow2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:10 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971700a-c299-4b47-9e76-168708a548a5 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de -F qcow2 Apr 10 10:35:10 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:10 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8 Apr 10 10:35:10 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:10 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_l_3jkf80" returned: 1 in 0.715s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_l_3jkf80' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e257611c-198a-4cf5-9f3d-ef067386b290]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:10 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b971700a-c299-4b47-9e76-168708a548a5 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de -F qcow2" returned: 0 in 0.609s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-3f26900f-cdb3-4a9e-8aa5-b07971943848" released by "_delete_snapshot" :: held 10.232s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-b971700a-c299-4b47-9e76-168708a548a5" released by "delete_snapshot" :: held 10.277s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:10 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD Apr 10 10:35:10 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Created reservations ['0bc06a39-95e2-4e7c-9be1-418a9e17a8d5', '201b6906-5818-4d79-861f-dbb50e9a1276', '65e91f60-21a4-4074-a138-69dd524d652b', 'eeedaf37-d5c2-4960-8fce-c9f4265c48a7'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:10 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8" returned: 0 in 0.779s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:11 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Delete snapshot completed successfully. Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-3f26900f-cdb3-4a9e-8aa5-b07971943848-delete_snapshot" released by "delete_snapshot" :: held 10.513s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-61f3dbc1-f4da-484b-88e4-9527501290de-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:11 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8 Apr 10 10:35:11 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-61f3dbc1-f4da-484b-88e4-9527501290de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-quobyte-b971700a-c299-4b47-9e76-168708a548a5" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-b971700a-c299-4b47-9e76-168708a548a5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-quobyte-61f3dbc1-f4da-484b-88e4-9527501290de" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-61f3dbc1-f4da-484b-88e4-9527501290de" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Deleting offline snapshot 61f3dbc1-f4da-484b-88e4-9527501290de of volume b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] snapshot_file for this snap is: volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cfc2d7-1c76-4622-b176-baebbd56c742]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:11 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de Apr 10 10:35:11 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:11 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3523f810-01b8-4d94-8001-1b54b09915d8" returned: 0 in 0.605s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Lock "cinder-quobyte-3523f810-01b8-4d94-8001-1b54b09915d8" released by "delete_volume" :: held 1.428s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:11 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD" returned: 0 in 0.861s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df was qcow2, converting to raw {{(pid=83037) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Created reservations ['0f615ccb-c755-42a6-b37e-eece84bcfac3', '28d6fc19-6e65-423a-824a-0e7ebfe8b3a5', '887fc18a-d1fd-46e6-afff-a960deef1d98', 'eb715893-1770-492b-8de7-97231792e6bf'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:11 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d Apr 10 10:35:11 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:11 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:35:11 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:11 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de" returned: 0 in 0.899s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b971700a-c299-4b47-9e76-168708a548a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d687806-890c-4919-b9dd-f1358afe5677]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:12 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 Apr 10 10:35:12 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:12 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.872s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:12 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Deleted volume successfully. Apr 10 10:35:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-386e006e-6b6a-4d87-b824-947972b0bd9f tempest-VolumesTransfersV355Test-2029816760 None] Lock "cinder-3523f810-01b8-4d94-8001-1b54b09915d8-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Flow 'volume_create_manager' (b981e1c4-5986-4c50-936a-a7d1bf673f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943c00df-4acc-4e48-9361-a3d58f3fcc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943c00df-4acc-4e48-9361-a3d58f3fcc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1242569586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58f65ed-6ed5-4b62-bc69-88a83edfe078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f54f94a8d4cf19e6ffbb8f4d45210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:13Z,use_quota=True,user_id='8d466a41bcd94dc891bd109eb89a0f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66db66df-049a-4e0d-a6b1-c9cc964c73e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66db66df-049a-4e0d-a6b1-c9cc964c73e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a509b89-72eb-4472-9c42-73c3ce8b747b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a509b89-72eb-4472-9c42-73c3ce8b747b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58f65ed-6ed5-4b62-bc69-88a83edfe078', 'volume_name': 'volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c67baa-73a5-4a00-a82d-737181a4e8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c67baa-73a5-4a00-a82d-737181a4e8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:13 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e111ef-2c46-4a89-a3b2-01199fc16d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:13 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Volume d58f65ed-6ed5-4b62-bc69-88a83edfe078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078', 'volume_size': 1} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:13 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1242569586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58f65ed-6ed5-4b62-bc69-88a83edfe078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f54f94a8d4cf19e6ffbb8f4d45210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:13Z,use_quota=True,user_id='8d466a41bcd94dc891bd109eb89a0f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Creating volume d58f65ed-6ed5-4b62-bc69-88a83edfe078 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:13 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5" returned: 0 in 1.356s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d" returned: 0 in 1.671s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:13 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078 1073741824 Apr 10 10:35:13 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_8gv7aua7devstack@QuobyteHD, size 112.00 MB, duration 1.68 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:35:13 devstack cinder-volume[83037]: INFO cinder.image.image_utils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Converted 112.00 MB image at 66.57 MB/s Apr 10 10:35:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:13 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de Apr 10 10:35:13 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:13 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d 1G Apr 10 10:35:13 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:14 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d 1G" returned: 0 in 0.780s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de" returned: 0 in 0.815s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f736184-6c68-4300-b960-2797aa88eaa9]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:14 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de Apr 10 10:35:14 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:14 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d Apr 10 10:35:14 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:14 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078 1073741824" returned: 0 in 1.124s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:14 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078 Apr 10 10:35:14 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:14 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5.61f3dbc1-f4da-484b-88e4-9527501290de" returned: 0 in 0.669s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-61f3dbc1-f4da-484b-88e4-9527501290de" released by "_delete_snapshot" :: held 3.803s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-b971700a-c299-4b47-9e76-168708a548a5" released by "delete_snapshot" :: held 3.817s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:14 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d" returned: 0 in 0.704s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:14 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Created reservations ['00f4af4c-ab5c-46ec-8b31-f8ec9c003e29', '8a23f77d-6f0c-449a-9d29-cfcfa17eed24', '7cbdaf93-d9b3-4737-a6f2-0aef81b2b0d9', '94361f44-85f7-4680-aeb0-835225cd165f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:14 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d Apr 10 10:35:14 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Delete snapshot completed successfully. Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-61f3dbc1-f4da-484b-88e4-9527501290de-delete_snapshot" released by "delete_snapshot" :: held 4.068s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Snapshots deleted, issuing volume delete {{(pid=83037) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-quobyte-b971700a-c299-4b47-9e76-168708a548a5" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-b971700a-c299-4b47-9e76-168708a548a5" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:15 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078" returned: 0 in 0.632s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e111ef-2c46-4a89-a3b2-01199fc16d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d7422b-21ce-4095-86c9-afdf6fdb3cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c337140-90b6-4f9c-86fa-d51e9406ecd0]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:15 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Volume volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078 (d58f65ed-6ed5-4b62-bc69-88a83edfe078): created successfully Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d7422b-21ce-4095-86c9-afdf6fdb3cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Flow 'volume_create_manager' (b981e1c4-5986-4c50-936a-a7d1bf673f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c90f152a-0200-445d-a780-7f673ea48680 tempest-VolumesTransfersV355Test-892513834 None] Created volume successfully. Apr 10 10:35:15 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 Apr 10 10:35:15 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:15 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d" returned: 1 in 0.710s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Downloaded image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df ((None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}])) to volume c5ad65ee-ea0b-43bd-834b-d409fc88650d successfully. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Temporary image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df for user 30499ce0e33745ec93a93e68d060fda0 is deleted. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Marking volume c5ad65ee-ea0b-43bd-834b-d409fc88650d as bootable. {{(pid=83037) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Copying metadata from image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df to c5ad65ee-ea0b-43bd-834b-d409fc88650d. {{(pid=83037) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Creating volume glance metadata for volume c5ad65ee-ea0b-43bd-834b-d409fc88650d backed by image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83037) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f5d2e3-a2d6-4d24-ba8a-87f718415ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c898b4b5-f3ca-4967-98a7-aff062b70abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:15 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Volume volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d (c5ad65ee-ea0b-43bd-834b-d409fc88650d): created successfully Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c898b4b5-f3ca-4967-98a7-aff062b70abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Flow 'volume_create_manager' (5245b54a-9cf4-4b1a-98fa-fa3b3d2bbba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-26ca4e81-4c18-4dd5-9520-56832ef4e1aa tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Created volume successfully. Apr 10 10:35:15 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5" returned: 0 in 0.756s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:15 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5 Apr 10 10:35:15 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:16 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b971700a-c299-4b47-9e76-168708a548a5" returned: 0 in 0.588s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-b971700a-c299-4b47-9e76-168708a548a5" released by "delete_volume" :: held 1.418s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Created reservations ['b55e8ad5-b7a4-4371-ac32-cc8c2359d19a', 'dc8c9fe7-43e6-4cf1-9da6-291a2659684e', '2adcf59e-b0b1-433d-8eb7-6d74d992701e', '0578d700-620e-486b-858d-283a3403af6d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Acquiring lock "cinder-d58f65ed-6ed5-4b62-bc69-88a83edfe078-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:16 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:35:16 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Lock "cinder-d58f65ed-6ed5-4b62-bc69-88a83edfe078-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Acquiring lock "cinder-quobyte-d58f65ed-6ed5-4b62-bc69-88a83edfe078" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Lock "cinder-quobyte-d58f65ed-6ed5-4b62-bc69-88a83edfe078" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93a6fc7-2c8c-4027-9d0a-6311422f488f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:16 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078 Apr 10 10:35:16 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:17 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.726s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Deleted volume successfully. Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76ff26ef-fb84-4982-9365-a42ad273032f tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-b971700a-c299-4b47-9e76-168708a548a5-delete_volume" released by "delete_volume" :: held 17.207s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-01356780-f39d-4312-9f55-b7991be0d03f tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-01356780-f39d-4312-9f55-b7991be0d03f tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b672190b-9cac-4885-853b-a33e207b8e2a]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-01356780-f39d-4312-9f55-b7991be0d03f tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:17 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d Apr 10 10:35:17 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:17 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078" returned: 0 in 0.931s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:17 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078 Apr 10 10:35:17 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Flow 'volume_create_manager' (6237e47d-db17-45cd-888e-fa1c516cfeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb759ff-756b-47cd-85ef-a95f84b14d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb759ff-756b-47cd-85ef-a95f84b14d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-655752508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f24af9e-fa90-4556-a554-5efa7b20986b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d091321724403391f9d9c191a803fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:18Z,use_quota=True,user_id='f4e7b6e0bdd248e58de0c7e27f888841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c85dc91-3df5-4944-98bb-5bde1f5c66d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c85dc91-3df5-4944-98bb-5bde1f5c66d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ccfee9-15dc-4878-a42b-cd0bd3137fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ccfee9-15dc-4878-a42b-cd0bd3137fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f24af9e-fa90-4556-a554-5efa7b20986b', 'volume_name': 'volume-3f24af9e-fa90-4556-a554-5efa7b20986b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e10a1bb-a241-4cb8-86a2-94f04ca153d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e10a1bb-a241-4cb8-86a2-94f04ca153d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edeb5329-5717-4266-a95f-8bd6081a0b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:17 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Volume 3f24af9e-fa90-4556-a554-5efa7b20986b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f24af9e-fa90-4556-a554-5efa7b20986b', 'volume_size': 1} Apr 10 10:35:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:18 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:18 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-01356780-f39d-4312-9f55-b7991be0d03f tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d" returned: 0 in 0.971s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-01356780-f39d-4312-9f55-b7991be0d03f tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d58f65ed-6ed5-4b62-bc69-88a83edfe078" returned: 0 in 0.812s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Lock "cinder-quobyte-d58f65ed-6ed5-4b62-bc69-88a83edfe078" released by "delete_volume" :: held 1.792s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:18 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d Apr 10 10:35:18 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:18 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Created reservations ['ca51e7ae-fb5c-439c-a249-b5fc1fc4d6f7', 'efa50a43-ea92-43ad-b634-7e07fdd0c3f7', '3a8e47e3-2459-4f50-9f18-6ce179ec0142', 'cb6f26ac-fc02-4555-9aa4-4152b1f76a32'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:18 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:35:18 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:19 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-01356780-f39d-4312-9f55-b7991be0d03f tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d" returned: 1 in 1.080s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-01356780-f39d-4312-9f55-b7991be0d03f tempest-ServerBootFromVolumeStableRescueTest-386617308 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-01356780-f39d-4312-9f55-b7991be0d03f tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.087s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.635s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-655752508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f24af9e-fa90-4556-a554-5efa7b20986b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d091321724403391f9d9c191a803fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:18Z,use_quota=True,user_id='f4e7b6e0bdd248e58de0c7e27f888841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Creating volume 3f24af9e-fa90-4556-a554-5efa7b20986b {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:19 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:19 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.959s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Deleted volume successfully. Apr 10 10:35:19 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b 1073741824 Apr 10 10:35:19 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-01356780-f39d-4312-9f55-b7991be0d03f tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac', 'name': 'volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a68a5e9-83a6-4c01-9e72-f8e88b5f7d3e', 'enforce_multipath': True} {{(pid=83037) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 10:35:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1cee4ee-4864-4bd0-b0cc-1a7e47f99bfc tempest-VolumesTransfersV355Test-2029816760 None] Lock "cinder-d58f65ed-6ed5-4b62-bc69-88a83edfe078-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-26fbff56-9dea-40bd-918f-e1c9a82b30b9 req-01356780-f39d-4312-9f55-b7991be0d03f tempest-ServerBootFromVolumeStableRescueTest-386617308 None] attachment_update completed successfully. Apr 10 10:35:20 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b 1073741824" returned: 0 in 1.047s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:20 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b Apr 10 10:35:20 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:21 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b" returned: 0 in 0.773s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edeb5329-5717-4266-a95f-8bd6081a0b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f24af9e-fa90-4556-a554-5efa7b20986b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7803bf-99d1-4580-9524-e986957af064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:21 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Volume volume-3f24af9e-fa90-4556-a554-5efa7b20986b (3f24af9e-fa90-4556-a554-5efa7b20986b): created successfully Apr 10 10:35:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7803bf-99d1-4580-9524-e986957af064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Flow 'volume_create_manager' (6237e47d-db17-45cd-888e-fa1c516cfeb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-79877fc2-5e23-4e3c-a91c-b9ad7a9775e5 tempest-VolumesDeleteCascade-1987215380 None] Created volume successfully. Apr 10 10:35:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] Creating offline snapshot 8399a42b-d773-45a0-bcdb-b692d8b9417d of volume 3f24af9e-fa90-4556-a554-5efa7b20986b {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:35:22 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c279d8-24ff-4399-a73f-4ca0fda9f9aa]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:22 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b Apr 10 10:35:22 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:23 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b" returned: 0 in 0.717s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:23 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d 1G Apr 10 10:35:23 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:23 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d 1G" returned: 0 in 0.743s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f24af9e-fa90-4556-a554-5efa7b20986b -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:23 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f24af9e-fa90-4556-a554-5efa7b20986b -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d Apr 10 10:35:23 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:24 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f24af9e-fa90-4556-a554-5efa7b20986b -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d" returned: 0 in 0.802s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:24 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d is being set with open permissions: ugo+rw Apr 10 10:35:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:24 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d Apr 10 10:35:24 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:25 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d" returned: 0 in 1.181s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:25 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.info Apr 10 10:35:25 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Flow 'volume_create_manager' (e881e38c-3581-4f76-8bea-fa5b5fec98ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5ac97c-12bd-4521-8cda-0c48ea7f8cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5ac97c-12bd-4521-8cda-0c48ea7f8cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1484060235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631da124-666c-4d89-bf58-ad612c8267e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c3340ea7ae405d88b0d16fb07703fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:27Z,use_quota=True,user_id='fcdb40a582ad42fbb58ebcff85adfbf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:27 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45542355-56d9-4ebf-9002-7f6168ad4a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45542355-56d9-4ebf-9002-7f6168ad4a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b0afab-57ce-472c-992c-1d8144a523ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b0afab-57ce-472c-992c-1d8144a523ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631da124-666c-4d89-bf58-ad612c8267e7', 'volume_name': 'volume-631da124-666c-4d89-bf58-ad612c8267e7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f0ef66-6b4a-491f-b712-56bc082b3cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f0ef66-6b4a-491f-b712-56bc082b3cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d51f47-d433-4935-9932-7a98c3bcff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:27 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Volume 631da124-666c-4d89-bf58-ad612c8267e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631da124-666c-4d89-bf58-ad612c8267e7', 'volume_size': 1} Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.info" returned: 0 in 1.515s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:27 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.info is being set with open permissions: ugo+rw Apr 10 10:35:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:27 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.info Apr 10 10:35:27 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:28 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.info" returned: 0 in 1.102s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.194s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.186s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1484060235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631da124-666c-4d89-bf58-ad612c8267e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c3340ea7ae405d88b0d16fb07703fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:27Z,use_quota=True,user_id='fcdb40a582ad42fbb58ebcff85adfbf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Creating volume 631da124-666c-4d89-bf58-ad612c8267e7 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:28 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:35:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:28 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7 1073741824 Apr 10 10:35:28 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1675c16b-a628-4051-82fc-b4d1582ea1f8 tempest-VolumesDeleteCascade-1987215380 None] Create snapshot completed successfully Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-62e816f8-7d83-44e3-9895-7355c0adb6e7 tempest-VolumesActionsTest-200790162 None] Acquiring lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca" by "attach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-62e816f8-7d83-44e3-9895-7355c0adb6e7 tempest-VolumesActionsTest-200790162 None] Lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca" acquired by "attach_volume" :: waited 0.031s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-62e816f8-7d83-44e3-9895-7355c0adb6e7 tempest-VolumesActionsTest-200790162 None] Attaching volume b3040f16-595f-48c6-88cd-3fa5499ba5ca to instance da89fc09-7c93-46be-a49f-28309ab34105 at mountpoint /dev/vdb on host None. Apr 10 10:35:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-62e816f8-7d83-44e3-9895-7355c0adb6e7 tempest-VolumesActionsTest-200790162 None] Attach volume completed successfully. Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-62e816f8-7d83-44e3-9895-7355c0adb6e7 tempest-VolumesActionsTest-200790162 None] Lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca" released by "attach_volume" :: held 0.092s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:30 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7 1073741824" returned: 0 in 1.729s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:30 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7 Apr 10 10:35:30 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Flow 'volume_create_manager' (0cc77060-8330-4fcd-9b3f-be9518232c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f305e6a-3fb5-4e6e-bb79-dc87721e95e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f305e6a-3fb5-4e6e-bb79-dc87721e95e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-532611393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44eb954e-c446-48eb-a58b-19ee67e756a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5d091321724403391f9d9c191a803fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8399a42b-d773-45a0-bcdb-b692d8b9417d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:30Z,use_quota=True,user_id='f4e7b6e0bdd248e58de0c7e27f888841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db8bbfa-9306-49c4-84da-a42044082d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db8bbfa-9306-49c4-84da-a42044082d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd733957-2207-4437-aa32-076d9d888e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd733957-2207-4437-aa32-076d9d888e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44eb954e-c446-48eb-a58b-19ee67e756a2', 'volume_name': 'volume-44eb954e-c446-48eb-a58b-19ee67e756a2', 'volume_size': 1, 'snapshot_id': '8399a42b-d773-45a0-bcdb-b692d8b9417d'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc80724-80c6-4cfd-99fd-073c04c7d8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc80724-80c6-4cfd-99fd-073c04c7d8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81967be9-cdbd-4165-8802-65623ceaf3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:30 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Volume 44eb954e-c446-48eb-a58b-19ee67e756a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44eb954e-c446-48eb-a58b-19ee67e756a2', 'volume_size': 1, 'snapshot_id': '8399a42b-d773-45a0-bcdb-b692d8b9417d'} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9d4a8f3a-ad32-47fc-96f3-79fccef9b0ec tempest-VolumesActionsTest-200790162 None] Acquiring lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca-detach_volume" by "detach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9d4a8f3a-ad32-47fc-96f3-79fccef9b0ec tempest-VolumesActionsTest-200790162 None] Lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9d4a8f3a-ad32-47fc-96f3-79fccef9b0ec tempest-VolumesActionsTest-200790162 None] Detaching volume b3040f16-595f-48c6-88cd-3fa5499ba5ca from instance da89fc09-7c93-46be-a49f-28309ab34105. Apr 10 10:35:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9d4a8f3a-ad32-47fc-96f3-79fccef9b0ec tempest-VolumesActionsTest-200790162 None] Detach volume completed successfully. Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9d4a8f3a-ad32-47fc-96f3-79fccef9b0ec tempest-VolumesActionsTest-200790162 None] Lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:31 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7" returned: 0 in 0.862s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] <== create_volume: return (2643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.651s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.619s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-quobyte-8399a42b-d773-45a0-bcdb-b692d8b9417d-44eb954e-c446-48eb-a58b-19ee67e756a2" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d51f47-d433-4935-9932-7a98c3bcff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631da124-666c-4d89-bf58-ad612c8267e7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803df910-1463-4aca-b05e-29880aaaf3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-8399a42b-d773-45a0-bcdb-b692d8b9417d-44eb954e-c446-48eb-a58b-19ee67e756a2" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Creating volume 44eb954e-c446-48eb-a58b-19ee67e756a2 from snapshot 8399a42b-d773-45a0-bcdb-b692d8b9417d {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-quobyte-44eb954e-c446-48eb-a58b-19ee67e756a2" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:31 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Volume volume-631da124-666c-4d89-bf58-ad612c8267e7 (631da124-666c-4d89-bf58-ad612c8267e7): created successfully Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803df910-1463-4aca-b05e-29880aaaf3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Flow 'volume_create_manager' (e881e38c-3581-4f76-8bea-fa5b5fec98ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a835f17d-013e-4d22-ab37-3973a3a10a89 tempest-VolumesTransfersV357Test-681358136 None] Created volume successfully. Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-44eb954e-c446-48eb-a58b-19ee67e756a2" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] snapshot: 8399a42b-d773-45a0-bcdb-b692d8b9417d, volume: 44eb954e-c446-48eb-a58b-19ee67e756a2, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cac688-698e-4a28-becc-889bdd3dce15]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:31 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d Apr 10 10:35:31 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:32 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d" returned: 0 in 1.091s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f24af9e-fa90-4556-a554-5efa7b20986b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:35:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:35:32 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb9b652-d220-4771-b6fd-0f202b7adc07]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d209ffed-0082-4619-a26e-6ba359cf5994 tempest-VolumesTransfersV357Test-1037911318 None] Transfer volume completed successfully. Apr 10 10:35:32 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b Apr 10 10:35:32 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:33 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b" returned: 0 in 0.813s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:33 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:35:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:33 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2 Apr 10 10:35:33 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Acquiring lock "cinder-631da124-666c-4d89-bf58-ad612c8267e7-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Lock "cinder-631da124-666c-4d89-bf58-ad612c8267e7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Acquiring lock "cinder-quobyte-631da124-666c-4d89-bf58-ad612c8267e7" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Lock "cinder-quobyte-631da124-666c-4d89-bf58-ad612c8267e7" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56f976d-6c5e-44b9-8ab8-69d23af32bb1]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:33 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7 Apr 10 10:35:33 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:35 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7" returned: 0 in 1.589s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:35 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7 Apr 10 10:35:35 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:36 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-631da124-666c-4d89-bf58-ad612c8267e7" returned: 0 in 1.223s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Lock "cinder-quobyte-631da124-666c-4d89-bf58-ad612c8267e7" released by "delete_volume" :: held 2.859s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Created reservations ['5a1e01d2-46b2-4f44-8ba0-c5ac31d051b3', '43170c33-8307-4760-8cfc-8edcfe4de394', '2823d17f-e86e-4133-a286-2822c4dbbcfa', '4eea5ed9-fbe2-4fea-b6c9-6499bb9cd71d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:36 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:35:36 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:37 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2" returned: 0 in 3.595s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6687550e-a2b4-467e-89eb-fc7d042592ff]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:37 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b Apr 10 10:35:37 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:37 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.611s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Deleted volume successfully. Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c211dee2-e130-4a1c-8998-d68acad90568 tempest-VolumesTransfersV357Test-67869124 None] Lock "cinder-631da124-666c-4d89-bf58-ad612c8267e7-delete_volume" released by "delete_volume" :: held 3.831s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Flow 'volume_create_manager' (3a881e84-bad3-4536-9f2e-c72b587229e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4991007e-ebf1-469a-b1ae-b7dc38e5c4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:37 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b" returned: 0 in 0.815s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b, size 1024.00 MB, duration 3.60 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:35:37 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Converted 1024.00 MB image at 284.70 MB/s Apr 10 10:35:37 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2 is being set with open permissions: ugo+rw Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4991007e-ebf1-469a-b1ae-b7dc38e5c4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2145500966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667f6c26-cd24-48f2-a0a4-066d4da3b148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c3340ea7ae405d88b0d16fb07703fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:38Z,use_quota=True,user_id='fcdb40a582ad42fbb58ebcff85adfbf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:37 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2 Apr 10 10:35:37 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169bc786-b238-4383-b3ac-1d58a8fa9805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169bc786-b238-4383-b3ac-1d58a8fa9805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5c7ada-e005-47ee-8b00-2b3758737de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5c7ada-e005-47ee-8b00-2b3758737de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667f6c26-cd24-48f2-a0a4-066d4da3b148', 'volume_name': 'volume-667f6c26-cd24-48f2-a0a4-066d4da3b148', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc2139e-9526-415b-8793-ceb0cdad0cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc2139e-9526-415b-8793-ceb0cdad0cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cc685a-0b29-4647-9dc0-fd8bf0d060ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:37 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Volume 667f6c26-cd24-48f2-a0a4-066d4da3b148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667f6c26-cd24-48f2-a0a4-066d4da3b148', 'volume_size': 1} Apr 10 10:35:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:38 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2" returned: 0 in 0.579s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-44eb954e-c446-48eb-a58b-19ee67e756a2" released by "_copy_volume_from_snapshot" :: held 7.056s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-8399a42b-d773-45a0-bcdb-b692d8b9417d-44eb954e-c446-48eb-a58b-19ee67e756a2" released by "_create_volume_from_snapshot" :: held 7.112s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.162s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.542s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2145500966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667f6c26-cd24-48f2-a0a4-066d4da3b148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c3340ea7ae405d88b0d16fb07703fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:38Z,use_quota=True,user_id='fcdb40a582ad42fbb58ebcff85adfbf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Creating volume 667f6c26-cd24-48f2-a0a4-066d4da3b148 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:38 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:38 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148 1073741824 Apr 10 10:35:38 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81967be9-cdbd-4165-8802-65623ceaf3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44eb954e-c446-48eb-a58b-19ee67e756a2', 'volume_size': 1, 'snapshot_id': '8399a42b-d773-45a0-bcdb-b692d8b9417d'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3384db12-64e7-4f1f-ae88-015df95701d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:38 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Volume volume-44eb954e-c446-48eb-a58b-19ee67e756a2 (44eb954e-c446-48eb-a58b-19ee67e756a2): created successfully Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3384db12-64e7-4f1f-ae88-015df95701d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Flow 'volume_create_manager' (0cc77060-8330-4fcd-9b3f-be9518232c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-70dd4b25-3693-4353-a7ed-9fe8ba5461cc tempest-VolumesDeleteCascade-1987215380 None] Created volume successfully. Apr 10 10:35:39 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148 1073741824" returned: 0 in 0.798s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:39 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148 Apr 10 10:35:39 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-3f24af9e-fa90-4556-a554-5efa7b20986b-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-3f24af9e-fa90-4556-a554-5efa7b20986b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Performing cascade delete. {{(pid=83037) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-8399a42b-d773-45a0-bcdb-b692d8b9417d-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-8399a42b-d773-45a0-bcdb-b692d8b9417d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-quobyte-3f24af9e-fa90-4556-a554-5efa7b20986b" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-3f24af9e-fa90-4556-a554-5efa7b20986b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-quobyte-8399a42b-d773-45a0-bcdb-b692d8b9417d" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-8399a42b-d773-45a0-bcdb-b692d8b9417d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Deleting offline snapshot 8399a42b-d773-45a0-bcdb-b692d8b9417d of volume 3f24af9e-fa90-4556-a554-5efa7b20986b {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] snapshot_file for this snap is: volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f684fff-7d26-4eaf-afe5-8acc0fc379a6]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:39 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148" returned: 0 in 0.608s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:39 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d Apr 10 10:35:39 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cc685a-0b29-4647-9dc0-fd8bf0d060ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667f6c26-cd24-48f2-a0a4-066d4da3b148', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de22ce5-11ce-4929-bbed-594f78e41cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Volume volume-667f6c26-cd24-48f2-a0a4-066d4da3b148 (667f6c26-cd24-48f2-a0a4-066d4da3b148): created successfully Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de22ce5-11ce-4929-bbed-594f78e41cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Flow 'volume_create_manager' (3a881e84-bad3-4536-9f2e-c72b587229e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:40 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4c561d29-fdc5-48f9-8983-5b5d752a5614 tempest-VolumesTransfersV357Test-681358136 None] Created volume successfully. Apr 10 10:35:40 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d" returned: 0 in 0.638s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f24af9e-fa90-4556-a554-5efa7b20986b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:40 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa1b1c6-502b-4a89-a915-550c0d686a92]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:40 devstack sudo[87524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b Apr 10 10:35:40 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:41 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b" returned: 0 in 0.686s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:41 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d Apr 10 10:35:41 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Acquiring lock "cinder-667f6c26-cd24-48f2-a0a4-066d4da3b148-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Lock "cinder-667f6c26-cd24-48f2-a0a4-066d4da3b148-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Acquiring lock "cinder-quobyte-667f6c26-cd24-48f2-a0a4-066d4da3b148" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Lock "cinder-quobyte-667f6c26-cd24-48f2-a0a4-066d4da3b148" acquired by "delete_volume" :: waited 0.028s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:41 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcf86a5-cfcf-4f4e-840c-393dcc3475ad]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:41 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148 Apr 10 10:35:41 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:42 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d" returned: 0 in 1.131s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:42 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d Apr 10 10:35:42 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:43 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148" returned: 0 in 1.306s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:43 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148 Apr 10 10:35:43 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:43 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b.8399a42b-d773-45a0-bcdb-b692d8b9417d" returned: 0 in 0.969s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-8399a42b-d773-45a0-bcdb-b692d8b9417d" released by "_delete_snapshot" :: held 3.515s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-3f24af9e-fa90-4556-a554-5efa7b20986b" released by "delete_snapshot" :: held 3.535s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed80a846-52cf-48eb-ac3c-33878e096eae]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Created reservations ['4158650a-a11f-4391-9157-fd3e1ab6148a', '055ebac5-676d-476d-ab11-ae8f6456c185', 'e7e9908c-640e-412d-93bf-964eb586d16a', '60598fb8-720d-4bcb-b888-00410ce37d33'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Delete snapshot completed successfully. Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-8399a42b-d773-45a0-bcdb-b692d8b9417d-delete_snapshot" released by "delete_snapshot" :: held 3.717s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Snapshots deleted, issuing volume delete {{(pid=83037) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-quobyte-3f24af9e-fa90-4556-a554-5efa7b20986b" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-3f24af9e-fa90-4556-a554-5efa7b20986b" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:43 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca Apr 10 10:35:43 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bad71b3-e1b7-4d81-b35c-b2dcac604400]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:43 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b Apr 10 10:35:43 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:43 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-667f6c26-cd24-48f2-a0a4-066d4da3b148" returned: 0 in 0.602s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Lock "cinder-quobyte-667f6c26-cd24-48f2-a0a4-066d4da3b148" released by "delete_volume" :: held 1.945s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Created reservations ['77fe9b91-2142-4845-bd2e-1be0f9158a97', '83973203-8144-4196-a2ec-145336183779', 'f56c8b36-8921-4743-a78c-3f37d06b90af', '0d734c64-8895-402c-a83c-1b77b3e6ccfb'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:43 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:35:43 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:44 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:44 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b" returned: 0 in 0.823s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca" returned: 0 in 0.978s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:44 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5763e68-4b3a-4375-8c35-97a47d66ed7b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:44 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b Apr 10 10:35:44 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:44 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca Apr 10 10:35:44 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:44 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.844s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:44 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Deleted volume successfully. Apr 10 10:35:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1a06317a-e4f0-49cd-802e-d3df08ccb6a4 tempest-VolumesTransfersV357Test-67869124 None] Lock "cinder-667f6c26-cd24-48f2-a0a4-066d4da3b148-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:44 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f24af9e-fa90-4556-a554-5efa7b20986b" returned: 0 in 0.643s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-3f24af9e-fa90-4556-a554-5efa7b20986b" released by "delete_volume" :: held 1.523s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Created reservations ['75b7ddc3-bb8b-4b46-acae-0b6ffa223895', '9c2719bd-eaec-4067-a74f-050d5fa303e0', 'a461bfeb-159c-4c10-975e-2264bb3356f7', '25d1f51c-74a7-45a5-bead-5ca93d14bff9'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:45 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:35:45 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:45 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca" returned: 0 in 0.860s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.5ecc72e1-15ea-45b0-b4d9-3d2bfcf601183z59cbtx.img {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:45 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.5ecc72e1-15ea-45b0-b4d9-3d2bfcf601183z59cbtx.img Apr 10 10:35:45 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-44eb954e-c446-48eb-a58b-19ee67e756a2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-44eb954e-c446-48eb-a58b-19ee67e756a2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "cinder-quobyte-44eb954e-c446-48eb-a58b-19ee67e756a2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-44eb954e-c446-48eb-a58b-19ee67e756a2" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1c4fac-ae8b-4ac5-b24c-002c49a77e97]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:45 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2 Apr 10 10:35:45 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:46 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 1.086s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:46 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Deleted volume successfully. Apr 10 10:35:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-78f9ab7d-1da8-47dc-a383-c886c0924109 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-3f24af9e-fa90-4556-a554-5efa7b20986b-delete_volume" released by "delete_volume" :: held 6.598s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:47 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2" returned: 0 in 1.892s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:47 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2 Apr 10 10:35:47 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:48 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.5ecc72e1-15ea-45b0-b4d9-3d2bfcf601183z59cbtx.img" returned: 0 in 3.739s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:49 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[440e7f63-e4a6-4d21-a9c4-31cb3b2ab66e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:49 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca Apr 10 10:35:49 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:49 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-44eb954e-c446-48eb-a58b-19ee67e756a2" returned: 0 in 1.683s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-quobyte-44eb954e-c446-48eb-a58b-19ee67e756a2" released by "delete_volume" :: held 3.632s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:49 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Created reservations ['a9a1d056-0101-47fc-8cbf-364e5d6f16f7', '5b171eba-28f7-48de-baa8-afd0325e8b9f', 'dd5c84fc-273a-428e-953a-3a478f7ba52e', 'f11c293e-0e39-4a21-91ce-9c0bbc3b9ed1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:49 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:35:49 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:50 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca" returned: 0 in 1.044s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:50 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca, size 1024.00 MB, duration 3.74 sec, destination /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.5ecc72e1-15ea-45b0-b4d9-3d2bfcf601183z59cbtx.img {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:35:50 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] Converted 1024.00 MB image at 273.76 MB/s Apr 10 10:35:50 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] 5ecc72e1-15ea-45b0-b4d9-3d2bfcf60118 was raw, no need to convert to raw {{(pid=83037) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 10 10:35:50 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.891s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:50 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Deleted volume successfully. Apr 10 10:35:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b1f45e90-794c-4963-abe3-bf283ad41622 tempest-VolumesDeleteCascade-1987215380 None] Lock "cinder-44eb954e-c446-48eb-a58b-19ee67e756a2-delete_volume" released by "delete_volume" :: held 4.881s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=101,cinder:INSERT=40,cinder:UPDATE=109,cinder:DELETE=9 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=114,cinder:UPDATE=117,cinder:INSERT=29,cinder:DELETE=9 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Flow 'volume_create_manager' (006d0bc3-72c3-4670-b686-313997bb4c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255fb59b-69fd-4858-b414-1baf3fe69964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255fb59b-69fd-4858-b414-1baf3fe69964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-435025303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836b471f-ab89-486f-994b-ef4e9a6d163f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171a224046744ca0b9a006c792544b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:54Z,use_quota=True,user_id='11a352dfc6c04ea5a5f5017dda215cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844c3b45-3977-4d9d-a500-a9c8cf15be98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844c3b45-3977-4d9d-a500-a9c8cf15be98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1678830b-da9e-4300-b395-4baf4e949583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1678830b-da9e-4300-b395-4baf4e949583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836b471f-ab89-486f-994b-ef4e9a6d163f', 'volume_name': 'volume-836b471f-ab89-486f-994b-ef4e9a6d163f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034572e6-b5a4-4fd1-a566-7d07fdef0021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034572e6-b5a4-4fd1-a566-7d07fdef0021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c331981-f555-47aa-8bfb-c3522f8a63e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Volume 836b471f-ab89-486f-994b-ef4e9a6d163f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836b471f-ab89-486f-994b-ef4e9a6d163f', 'volume_size': 1} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Flow 'volume_create_manager' (628d866f-8e91-4ba1-b963-2a59db46f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0432c488-2573-4622-b0cc-50e9538f8bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0432c488-2573-4622-b0cc-50e9538f8bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-167392029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76b36c4-3a18-4c74-9700-1671bdb275bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21db7f84c58d432b81a5f1a83dc78afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:55Z,use_quota=True,user_id='8721eccecba949c49f2cc8936a654367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6843ec2d-e2e6-4bd7-916f-334cf3b82d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6843ec2d-e2e6-4bd7-916f-334cf3b82d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c202b9-29e6-4c4f-a58a-86cc05d72473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c202b9-29e6-4c4f-a58a-86cc05d72473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76b36c4-3a18-4c74-9700-1671bdb275bb', 'volume_name': 'volume-b76b36c4-3a18-4c74-9700-1671bdb275bb', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0676bbb-a237-4748-9e18-974aba6779a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0676bbb-a237-4748-9e18-974aba6779a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f5c0aa-cd1e-4e86-93b7-66585dd4df85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Volume b76b36c4-3a18-4c74-9700-1671bdb275bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76b36c4-3a18-4c74-9700-1671bdb275bb', 'volume_size': 1} Apr 10 10:35:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:56 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-5140bfbb-b41e-4b0c-82b1-f3e3e4c5d4e3 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Terminate volume connection completed successfully. Apr 10 10:35:56 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-5140bfbb-b41e-4b0c-82b1-f3e3e4c5d4e3 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Deleting attachment 6a68a5e9-83a6-4c01-9e72-f8e88b5f7d3e. {{(pid=83037) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "cinder-c5ad65ee-ea0b-43bd-834b-d409fc88650d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "cinder-c5ad65ee-ea0b-43bd-834b-d409fc88650d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "cinder-quobyte-c5ad65ee-ea0b-43bd-834b-d409fc88650d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "cinder-quobyte-c5ad65ee-ea0b-43bd-834b-d409fc88650d" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[498a39be-6647-47dc-a4a6-213a79b5c2b0]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:57 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d Apr 10 10:35:57 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:57 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:35:57 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:58 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d" returned: 0 in 0.793s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:58 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.645s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:58 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d Apr 10 10:35:58 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:58 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d" returned: 1 in 0.662s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:59 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d Apr 10 10:35:59 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:59 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c5ad65ee-ea0b-43bd-834b-d409fc88650d" returned: 0 in 0.599s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "cinder-quobyte-c5ad65ee-ea0b-43bd-834b-d409fc88650d" released by "delete_volume" :: held 2.124s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG cinder.quota [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Created reservations ['c8d5cece-558f-479a-b609-e736950f0bf8', '8d3210ca-ee2e-40ee-a269-b0047961a6d5', '292eeea4-a22c-4ea8-88ae-3fe2f8f253f9', '6f19a6b6-67ff-4d03-b74c-0c17e672cfb6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:59 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:35:59 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:00 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.640s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:00 devstack cinder-volume[83037]: DEBUG cinder.manager [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Deleted volume successfully. Apr 10 10:36:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-2e88da52-8c03-499c-8de1-9d7a1e183a19 req-0d7e2670-2889-486d-9067-a1c80e746901 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "cinder-c5ad65ee-ea0b-43bd-834b-d409fc88650d-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 21.046s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] Uploaded volume to glance image-id: 5ecc72e1-15ea-45b0-b4d9-3d2bfcf60118. {{(pid=83037) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.956s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-435025303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836b471f-ab89-486f-994b-ef4e9a6d163f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171a224046744ca0b9a006c792544b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:54Z,use_quota=True,user_id='11a352dfc6c04ea5a5f5017dda215cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Creating volume 836b471f-ab89-486f-994b-ef4e9a6d163f {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:04 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8e7caa12-40f6-4e1d-92dd-997a8d43e12e tempest-VolumesActionsTest-200790162 None] Copy volume to image completed successfully. Apr 10 10:36:04 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f 1073741824 Apr 10 10:36:04 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:04 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f 1073741824" returned: 0 in 0.565s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:05 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f Apr 10 10:36:05 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:05 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.678s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-167392029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76b36c4-3a18-4c74-9700-1671bdb275bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21db7f84c58d432b81a5f1a83dc78afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:55Z,use_quota=True,user_id='8721eccecba949c49f2cc8936a654367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Creating volume b76b36c4-3a18-4c74-9700-1671bdb275bb {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:05 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c331981-f555-47aa-8bfb-c3522f8a63e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836b471f-ab89-486f-994b-ef4e9a6d163f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46683a04-ffab-4ecc-a402-d9b34d576427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:05 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb 1073741824 Apr 10 10:36:05 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:05 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Volume volume-836b471f-ab89-486f-994b-ef4e9a6d163f (836b471f-ab89-486f-994b-ef4e9a6d163f): created successfully Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46683a04-ffab-4ecc-a402-d9b34d576427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Flow 'volume_create_manager' (006d0bc3-72c3-4670-b686-313997bb4c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f6a696f4-467c-4051-86db-d8649cd343df tempest-VolumesCloneTest-334868803 None] Created volume successfully. Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:06 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb 1073741824" returned: 0 in 0.634s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:06 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb Apr 10 10:36:06 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Flow 'volume_create_manager' (20e129f8-f8d3-41d4-b982-3eb5cce03a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773936e6-cc7d-4666-a8a2-4a8ec47389e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773936e6-cc7d-4666-a8a2-4a8ec47389e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-71509067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20bcf76-0e45-41a6-85dd-0fa0a525c6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171a224046744ca0b9a006c792544b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=836b471f-ab89-486f-994b-ef4e9a6d163f,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:06Z,use_quota=True,user_id='11a352dfc6c04ea5a5f5017dda215cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19116e2b-62ab-4f90-b98d-749ed0d91253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19116e2b-62ab-4f90-b98d-749ed0d91253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307ce5d0-239f-49a5-a883-7ed14bfe9078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307ce5d0-239f-49a5-a883-7ed14bfe9078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b20bcf76-0e45-41a6-85dd-0fa0a525c6e0', 'volume_name': 'volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0', 'volume_size': 2, 'source_volid': '836b471f-ab89-486f-994b-ef4e9a6d163f', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463900c5-d92f-4ba3-b930-128a858db675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463900c5-d92f-4ba3-b930-128a858db675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db08579-3a16-4637-842b-3b49015975e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Volume b20bcf76-0e45-41a6-85dd-0fa0a525c6e0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0', 'volume_size': 2, 'source_volid': '836b471f-ab89-486f-994b-ef4e9a6d163f', 'source_volstatus': 'available'} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:06 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb" returned: 0 in 0.554s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.595s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[25beea21-8acc-4f9e-b9cc-78446f42040c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f5c0aa-cd1e-4e86-93b7-66585dd4df85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76b36c4-3a18-4c74-9700-1671bdb275bb', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b29ac2-c706-41f4-829e-386a38e3d1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Volume volume-b76b36c4-3a18-4c74-9700-1671bdb275bb (b76b36c4-3a18-4c74-9700-1671bdb275bb): created successfully Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b29ac2-c706-41f4-829e-386a38e3d1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Flow 'volume_create_manager' (628d866f-8e91-4ba1-b963-2a59db46f458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-176f29e3-60fc-4ba3-9ae4-47d399f59737 tempest-VolumesMetadataTest-1442618686 None] Created volume successfully. Apr 10 10:36:06 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca Apr 10 10:36:06 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:07 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca" returned: 0 in 0.535s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6544b4f-bf68-4325-8ff1-4c7e3088d31c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:07 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca Apr 10 10:36:07 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:07 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca" returned: 0 in 0.550s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:07 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img Apr 10 10:36:07 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Acquiring lock "cinder-b76b36c4-3a18-4c74-9700-1671bdb275bb-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Lock "cinder-b76b36c4-3a18-4c74-9700-1671bdb275bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Acquiring lock "cinder-quobyte-b76b36c4-3a18-4c74-9700-1671bdb275bb" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Lock "cinder-quobyte-b76b36c4-3a18-4c74-9700-1671bdb275bb" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:08 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d1c495-2c82-414b-839d-414a1d653b61]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:08 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb Apr 10 10:36:08 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:10 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb" returned: 0 in 1.998s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:10 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb Apr 10 10:36:10 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:10 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img" returned: 0 in 3.048s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32fe1ff-5833-4164-a5cc-323290750c37]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:11 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca Apr 10 10:36:11 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:11 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b76b36c4-3a18-4c74-9700-1671bdb275bb" returned: 0 in 0.904s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Lock "cinder-quobyte-b76b36c4-3a18-4c74-9700-1671bdb275bb" released by "delete_volume" :: held 2.936s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Created reservations ['beae5ebb-3785-4d24-8f51-67aed1ba1bfe', '8dc81457-3626-4c85-ad41-bc06e06593b4', '88238377-223d-4608-81db-b0ce5cc652bb', 'c7bd5345-00f0-466f-b584-1e2c180432b0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:11 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:36:11 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:11 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca" returned: 0 in 0.791s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca, size 1024.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:36:11 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Converted 1024.00 MB image at 335.86 MB/s Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] d334c94e-8d76-44ed-bd9b-0e2586275206 was raw, converting to qcow2 {{(pid=83037) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[659e12d6-339f-48f7-8f10-72601d707b07]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:11 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img Apr 10 10:36:11 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:12 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.708s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:12 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Deleted volume successfully. Apr 10 10:36:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-36906bb6-9da7-4d22-b00e-fa407f4d9700 tempest-VolumesMetadataTest-1442618686 None] Lock "cinder-b76b36c4-3a18-4c74-9700-1671bdb275bb-delete_volume" released by "delete_volume" :: held 3.858s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:12 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img" returned: 0 in 0.743s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:12 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img Apr 10 10:36:12 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-5ec776b8-ab59-40d9-b2ca-8b0a9864c3a1 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Terminate volume connection completed successfully. Apr 10 10:36:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-5ec776b8-ab59-40d9-b2ca-8b0a9864c3a1 tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Deleting attachment bb9fb10b-ea03-4058-a785-bfb8a7656a82. {{(pid=83037) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 10:36:13 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img" returned: 1 in 0.688s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img /opt/stack/data/cinder/conversion/vol_upload_czsz_z0p {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:13 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img /opt/stack/data/cinder/conversion/vol_upload_czsz_z0p Apr 10 10:36:13 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "cinder-82f04873-8470-42e4-99f9-35317ea6754e-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "cinder-82f04873-8470-42e4-99f9-35317ea6754e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "cinder-quobyte-82f04873-8470-42e4-99f9-35317ea6754e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "cinder-quobyte-82f04873-8470-42e4-99f9-35317ea6754e" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[677757e1-a085-4a62-b969-2c5199d09409]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:13 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:13 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e Apr 10 10:36:13 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img /opt/stack/data/cinder/conversion/vol_upload_czsz_z0p" returned: 0 in 0.594s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Image conversion details: src /opt/stack/data/cinder/conversion/b3040f16-595f-48c6-88cd-3fa5499ba5ca.temp_image.d334c94e-8d76-44ed-bd9b-0e25862752062q73hu2u.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_czsz_z0p {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:36:13 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4102ca2-99ef-48a5-9db0-cf11394e8e65]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_czsz_z0p {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:13 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_czsz_z0p Apr 10 10:36:13 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:14 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (0c719e31-c79d-4ccf-8c44-915ecd929d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e004b1-5b9c-4eaa-8d7b-5b43abd6b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e" returned: 0 in 0.694s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e004b1-5b9c-4eaa-8d7b-5b43abd6b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-619597280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f56a9ba-5b85-42ca-9a1b-fc078e21fd20,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:14Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3512c82-1ef2-4464-be09-29097f36f6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:14 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e Apr 10 10:36:14 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3512c82-1ef2-4464-be09-29097f36f6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60eb8ed4-ddd9-4c6f-a00c-11205b361103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60eb8ed4-ddd9-4c6f-a00c-11205b361103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f56a9ba-5b85-42ca-9a1b-fc078e21fd20', 'volume_name': 'volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735ff2b4-157b-4f32-ac33-db066b981fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735ff2b4-157b-4f32-ac33-db066b981fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:14 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0583e274-131f-4eb5-acb6-5d9bc459aede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:14 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Volume 6f56a9ba-5b85-42ca-9a1b-fc078e21fd20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20', 'volume_size': 1} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_czsz_z0p" returned: 0 in 0.655s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:14 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82f04873-8470-42e4-99f9-35317ea6754e" returned: 0 in 0.534s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "cinder-quobyte-82f04873-8470-42e4-99f9-35317ea6754e" released by "delete_volume" :: held 1.271s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.quota [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Created reservations ['5d8940c1-1488-4f24-a765-f8b42ba442ba', '913b1e3a-5ce4-48f9-ac73-e33b1902c1d7', '67b32219-4e4f-4e37-bfc6-5a408bce11ee', '7a776e6a-3d04-44e4-99ad-aecc9f658ec0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:15 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:36:15 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:15 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.593s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:15 devstack cinder-volume[83037]: DEBUG cinder.manager [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Deleted volume successfully. Apr 10 10:36:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-19a292a9-a5ae-4192-bcca-6a9613b405ec req-f2643834-0501-45d0-b0e9-93b30abbca4e tempest-ServerBootFromVolumeStableRescueTest-386617308 None] Lock "cinder-82f04873-8470-42e4-99f9-35317ea6754e-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.935s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Uploaded volume to glance image-id: d334c94e-8d76-44ed-bd9b-0e2586275206. {{(pid=83037) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 10:36:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.096s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:15 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Cloning volume 836b471f-ab89-486f-994b-ef4e9a6d163f to volume b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 Apr 10 10:36:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-337d4ce5-6958-433e-8701-a09203507a60 tempest-VolumesActionsTest-200790162 None] Copy volume to image completed successfully. Apr 10 10:36:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Creating offline snapshot c7d1398f-d1bb-41b3-bd35-418ebe57cd77 of volume 836b471f-ab89-486f-994b-ef4e9a6d163f {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2003ff-5314-4618-985b-749f1496a546]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:15 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f Apr 10 10:36:15 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:16 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f" returned: 0 in 0.637s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:16 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 1G Apr 10 10:36:16 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:17 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 1G" returned: 0 in 0.692s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836b471f-ab89-486f-994b-ef4e9a6d163f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:17 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836b471f-ab89-486f-994b-ef4e9a6d163f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 Apr 10 10:36:17 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Acquiring lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Acquiring lock "cinder-quobyte-b3040f16-595f-48c6-88cd-3fa5499ba5ca" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Lock "cinder-quobyte-b3040f16-595f-48c6-88cd-3fa5499ba5ca" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d7a09f-2deb-4328-b5d4-f1e39734c610]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:17 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca Apr 10 10:36:17 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:17 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-836b471f-ab89-486f-994b-ef4e9a6d163f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77" returned: 0 in 0.676s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:17 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 is being set with open permissions: ugo+rw Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:17 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 Apr 10 10:36:17 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:17 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca" returned: 0 in 0.652s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:17 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca Apr 10 10:36:17 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:18 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77" returned: 0 in 0.536s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:18 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.info Apr 10 10:36:18 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:18 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3040f16-595f-48c6-88cd-3fa5499ba5ca" returned: 0 in 0.652s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Lock "cinder-quobyte-b3040f16-595f-48c6-88cd-3fa5499ba5ca" released by "delete_volume" :: held 1.338s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Created reservations ['8ab7d19a-dd52-4008-8003-65acfa7882c5', 'cf80b3a0-387c-4b57-a0d5-9018856027a5', '6cc2a345-317c-43e3-84f4-4b46eae0cab8', '85fab802-a9b3-4098-8b3e-0a682bc824b1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:18 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:36:18 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:18 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.info" returned: 0 in 0.670s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:18 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.info is being set with open permissions: ugo+rw Apr 10 10:36:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:18 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.info Apr 10 10:36:18 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:19 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.557s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Deleted volume successfully. Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae019e3d-79d5-4bae-8ec4-57bdbfd29397 tempest-VolumesActionsTest-200790162 None] Lock "cinder-b3040f16-595f-48c6-88cd-3fa5499ba5ca-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:19 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.info" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Acquiring lock "cinder-quobyte-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Lock "cinder-quobyte-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] snapshot: c7d1398f-d1bb-41b3-bd35-418ebe57cd77, volume: b20bcf76-0e45-41a6-85dd-0fa0a525c6e0, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a02acf5-559c-4096-889d-ebcf901f987e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:19 devstack sudo[87937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 Apr 10 10:36:19 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:20 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77" returned: 0 in 0.719s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-836b471f-ab89-486f-994b-ef4e9a6d163f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:36:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:36:20 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3258e6-f885-43fd-8607-894095001c96]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:20 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f Apr 10 10:36:20 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:20 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f" returned: 0 in 0.644s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:20 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:36:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:20 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 Apr 10 10:36:20 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:23 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0" returned: 0 in 2.968s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1997caa7-cc28-4e0a-854c-3e56c03be775]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:23 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f Apr 10 10:36:23 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:24 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f" returned: 0 in 0.910s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:24 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f, size 1024.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:36:24 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Converted 1024.00 MB image at 344.80 MB/s Apr 10 10:36:24 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 is being set with open permissions: ugo+rw Apr 10 10:36:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:24 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 Apr 10 10:36:24 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:25 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0" returned: 0 in 0.695s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Lock "cinder-quobyte-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0" released by "_copy_volume_from_snapshot" :: held 5.999s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Acquiring lock "cinder-quobyte-c7d1398f-d1bb-41b3-bd35-418ebe57cd77" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Lock "cinder-quobyte-c7d1398f-d1bb-41b3-bd35-418ebe57cd77" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Deleting offline snapshot c7d1398f-d1bb-41b3-bd35-418ebe57cd77 of volume 836b471f-ab89-486f-994b-ef4e9a6d163f {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:36:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] snapshot_file for this snap is: volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:36:25 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[215cbcec-db02-4302-887a-7e43d209e98d]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:25 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 Apr 10 10:36:25 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:26 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77" returned: 0 in 0.744s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-836b471f-ab89-486f-994b-ef4e9a6d163f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[306ad456-1241-4e63-b598-bd099b9db991]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:26 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f Apr 10 10:36:26 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (7a07e220-f701-40ea-a2dd-f62df1956f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cb2213-bfc5-4252-a73f-533211f752d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cb2213-bfc5-4252-a73f-533211f752d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-418992618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa754abb-fcb1-4d82-a961-7a8303928f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:27Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6559c5fd-50c6-4cd7-86e1-ee5a540d0e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6559c5fd-50c6-4cd7-86e1-ee5a540d0e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d080850c-cd12-44cc-ae5e-93e329a448d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d080850c-cd12-44cc-ae5e-93e329a448d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa754abb-fcb1-4d82-a961-7a8303928f22', 'volume_name': 'volume-fa754abb-fcb1-4d82-a961-7a8303928f22', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf72a45-9998-4e1b-b9ef-a2ebf53a6ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf72a45-9998-4e1b-b9ef-a2ebf53a6ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c64dd5-8b00-412d-b00f-7c9c0366c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume fa754abb-fcb1-4d82-a961-7a8303928f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa754abb-fcb1-4d82-a961-7a8303928f22', 'volume_size': 1} Apr 10 10:36:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:27 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f" returned: 0 in 0.891s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:27 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 Apr 10 10:36:27 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:27 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77" returned: 0 in 0.625s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:27 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77 Apr 10 10:36:27 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:28 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f.c7d1398f-d1bb-41b3-bd35-418ebe57cd77" returned: 0 in 0.508s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Lock "cinder-quobyte-c7d1398f-d1bb-41b3-bd35-418ebe57cd77" released by "_delete_snapshot" :: held 2.859s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.763s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.024s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-619597280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f56a9ba-5b85-42ca-9a1b-fc078e21fd20,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:14Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Creating volume 6f56a9ba-5b85-42ca-9a1b-fc078e21fd20 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:28 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db08579-3a16-4637-842b-3b49015975e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0', 'volume_size': 2, 'source_volid': '836b471f-ab89-486f-994b-ef4e9a6d163f', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:28 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20 1073741824 Apr 10 10:36:28 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a1bf1e-7385-4005-9c3e-6ea36608cd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:28 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Volume volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 (b20bcf76-0e45-41a6-85dd-0fa0a525c6e0): created successfully Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a1bf1e-7385-4005-9c3e-6ea36608cd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Flow 'volume_create_manager' (20e129f8-f8d3-41d4-b982-3eb5cce03a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3bdf26ec-115e-49c3-81f6-46ebaf8ba7af tempest-VolumesCloneTest-334868803 None] Created volume successfully. Apr 10 10:36:29 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20 1073741824" returned: 0 in 0.641s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:29 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20 Apr 10 10:36:29 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:29 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20" returned: 0 in 0.556s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.803s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-418992618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa754abb-fcb1-4d82-a961-7a8303928f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:27Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Creating volume fa754abb-fcb1-4d82-a961-7a8303928f22 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:29 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:29 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 1073741824 Apr 10 10:36:29 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Acquiring lock "cinder-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0583e274-131f-4eb5-acb6-5d9bc459aede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648f769f-548a-475e-8db0-3b921006cef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Lock "cinder-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:29 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Volume volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20 (6f56a9ba-5b85-42ca-9a1b-fc078e21fd20): created successfully Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648f769f-548a-475e-8db0-3b921006cef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (0c719e31-c79d-4ccf-8c44-915ecd929d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b9d8d690-4b80-45c3-913b-1621183a1580 tempest-VolumesGetTest-31708936 None] Created volume successfully. Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Acquiring lock "cinder-quobyte-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Lock "cinder-quobyte-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0a8815-fec8-4d6f-817e-6925d8e8ba65]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:30 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 Apr 10 10:36:30 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:30 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 1073741824" returned: 0 in 0.817s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:30 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0" returned: 0 in 0.653s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:30 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0 Apr 10 10:36:30 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:30 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 Apr 10 10:36:30 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:30 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Flow 'volume_create_manager' (c428737d-ae0c-4822-8195-c54ffb7b9544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cda72d-6183-405a-972f-a5d34278900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cda72d-6183-405a-972f-a5d34278900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2010961388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a37c9c-53f4-4a8d-a5f2-2431222bc698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b1e48d66884214b797ec7e4827af01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:31Z,use_quota=True,user_id='7ef28571476743d78db13df0af5c8954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c5e0c7-91ed-4e27-974a-9dc52ef86664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c5e0c7-91ed-4e27-974a-9dc52ef86664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b359c2ad-9796-4ad9-a2b7-4d1b0f70c9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b359c2ad-9796-4ad9-a2b7-4d1b0f70c9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a37c9c-53f4-4a8d-a5f2-2431222bc698', 'volume_name': 'volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eed5488-94fd-4d31-8ce4-5b13396b41d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eed5488-94fd-4d31-8ce4-5b13396b41d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89037aef-ec44-4a7b-838b-a849f811a4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Volume 39a37c9c-53f4-4a8d-a5f2-2431222bc698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698', 'volume_size': 1} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:31 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (648bd61d-dd81-4d7d-9629-e6df6c7aa6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f06a68a-7dcb-4ef6-8cd0-f63899e8c980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0" returned: 0 in 0.668s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f06a68a-7dcb-4ef6-8cd0-f63899e8c980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1395120089',display_name='tempest-VolumesGetTest-Volume-86244791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f42f57-ad24-4e70-ad84-c2409e7c88e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:31Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb6c649-45d0-4ef8-b387-0e67f20ecbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb6c649-45d0-4ef8-b387-0e67f20ecbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59305124-4955-4c9c-b9b5-724584f6b82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59305124-4955-4c9c-b9b5-724584f6b82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65f42f57-ad24-4e70-ad84-c2409e7c88e9', 'volume_name': 'volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a2c6b9-71e5-4605-aa98-2afb90806d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a2c6b9-71e5-4605-aa98-2afb90806d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c901a574-7977-4857-bf2a-adc129579c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Volume 65f42f57-ad24-4e70-ad84-c2409e7c88e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9', 'volume_size': 1} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Lock "cinder-quobyte-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0" released by "delete_volume" :: held 1.413s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22" returned: 0 in 0.683s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.258s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2010961388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a37c9c-53f4-4a8d-a5f2-2431222bc698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b1e48d66884214b797ec7e4827af01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:31Z,use_quota=True,user_id='7ef28571476743d78db13df0af5c8954',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Creating volume 39a37c9c-53f4-4a8d-a5f2-2431222bc698 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:31 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:31 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 1073741824 Apr 10 10:36:31 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c64dd5-8b00-412d-b00f-7c9c0366c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa754abb-fcb1-4d82-a961-7a8303928f22', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab3a6a8-958e-4847-8a72-4de4fdc08677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume volume-fa754abb-fcb1-4d82-a961-7a8303928f22 (fa754abb-fcb1-4d82-a961-7a8303928f22): created successfully Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab3a6a8-958e-4847-8a72-4de4fdc08677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (7a07e220-f701-40ea-a2dd-f62df1956f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Created reservations ['7e47e0e1-70a1-4367-bae8-61ca62a72087', 'a86fa323-fe60-44a5-a98d-cbbe3163ce81', '01af0291-f80b-4b5c-8a8a-839344cdfa19', '25a4bf52-4a66-485d-9c2d-f50afde99c09'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-eb3e3297-44d6-43da-9c4c-4e8692ce790a tempest-CreateVolumesFromSnapshotTest-221035917 None] Created volume successfully. Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:31 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:36:31 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:31 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 1073741824" returned: 0 in 0.592s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:31 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.523s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:31 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:31 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 Apr 10 10:36:31 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Deleted volume successfully. Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ecbd4707-cf70-48a7-8d0a-2ff064ea04e8 tempest-VolumesCloneTest-334868803 None] Lock "cinder-b20bcf76-0e45-41a6-85dd-0fa0a525c6e0-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Acquiring lock "cinder-836b471f-ab89-486f-994b-ef4e9a6d163f-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Lock "cinder-836b471f-ab89-486f-994b-ef4e9a6d163f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Acquiring lock "cinder-quobyte-836b471f-ab89-486f-994b-ef4e9a6d163f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Lock "cinder-quobyte-836b471f-ab89-486f-994b-ef4e9a6d163f" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[536cb150-d7bf-4997-a4f4-34b4b20e5fd3]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:32 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f Apr 10 10:36:32 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:32 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698" returned: 0 in 0.545s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.199s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1395120089',display_name='tempest-VolumesGetTest-Volume-86244791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f42f57-ad24-4e70-ad84-c2409e7c88e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:31Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Creating volume 65f42f57-ad24-4e70-ad84-c2409e7c88e9 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:32 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89037aef-ec44-4a7b-838b-a849f811a4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:32 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9 1073741824 Apr 10 10:36:32 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98daf6c-7cc4-4b58-ba9d-d734f5fd2e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:32 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Volume volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 (39a37c9c-53f4-4a8d-a5f2-2431222bc698): created successfully Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98daf6c-7cc4-4b58-ba9d-d734f5fd2e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Flow 'volume_create_manager' (c428737d-ae0c-4822-8195-c54ffb7b9544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-cf73d62d-ab6a-468c-a781-b26d2c422956 req-ce0f2b79-2ed3-43a9-b288-55e1b54e25ba tempest-VolumesSnapshotsTestJSON-79493321 None] Created volume successfully. Apr 10 10:36:32 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f" returned: 0 in 0.667s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:32 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f Apr 10 10:36:32 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:33 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9 1073741824" returned: 0 in 0.669s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:33 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9 Apr 10 10:36:33 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:33 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-836b471f-ab89-486f-994b-ef4e9a6d163f" returned: 0 in 0.685s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Lock "cinder-quobyte-836b471f-ab89-486f-994b-ef4e9a6d163f" released by "delete_volume" :: held 1.408s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Created reservations ['31658d65-a8ec-4c37-8a82-3bb54c19b850', '099ac0ab-e467-4354-bf10-965428cfe9be', 'bc617293-a349-40ea-bf70-5c907c514f1d', '36b1a10d-1f52-4dac-ab69-b5aab60b6958'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:33 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:36:33 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:33 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9" returned: 0 in 0.646s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.529s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] Creating offline snapshot 86f97185-10bc-492b-a6ef-9fdef816e2d4 of volume fa754abb-fcb1-4d82-a961-7a8303928f22 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c901a574-7977-4857-bf2a-adc129579c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10df436-65c4-4cab-9e12-8a9614404339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdcd2cc-f213-4938-b862-c08b93c0c814]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:33 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Volume volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9 (65f42f57-ad24-4e70-ad84-c2409e7c88e9): created successfully Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10df436-65c4-4cab-9e12-8a9614404339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:33 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (648bd61d-dd81-4d7d-9629-e6df6c7aa6f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-32085eef-0d1c-43a4-bcd9-3a880118ee45 tempest-VolumesGetTest-31708936 None] Created volume successfully. Apr 10 10:36:34 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 Apr 10 10:36:34 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:34 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.516s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:34 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:34 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Deleted volume successfully. Apr 10 10:36:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4a664a5d-32fc-4843-96a5-9e723297afdb tempest-VolumesCloneTest-334868803 None] Lock "cinder-836b471f-ab89-486f-994b-ef4e9a6d163f-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:34 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22" returned: 0 in 0.696s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:34 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 1G Apr 10 10:36:34 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-65f42f57-ad24-4e70-ad84-c2409e7c88e9-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Lock "cinder-65f42f57-ad24-4e70-ad84-c2409e7c88e9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-quobyte-65f42f57-ad24-4e70-ad84-c2409e7c88e9" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-65f42f57-ad24-4e70-ad84-c2409e7c88e9" acquired by "delete_volume" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[830c2da4-c3b6-43bf-b528-01df3b154182]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:34 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9 Apr 10 10:36:34 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:35 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 1G" returned: 0 in 0.643s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa754abb-fcb1-4d82-a961-7a8303928f22 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:35 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa754abb-fcb1-4d82-a961-7a8303928f22 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 Apr 10 10:36:35 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:35 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9" returned: 0 in 0.626s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:35 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9 Apr 10 10:36:35 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:35 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa754abb-fcb1-4d82-a961-7a8303928f22 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4" returned: 0 in 0.647s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:35 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 is being set with open permissions: ugo+rw Apr 10 10:36:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:35 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 Apr 10 10:36:35 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:36 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-65f42f57-ad24-4e70-ad84-c2409e7c88e9" returned: 0 in 0.616s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-65f42f57-ad24-4e70-ad84-c2409e7c88e9" released by "delete_volume" :: held 1.276s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Created reservations ['8aaa9748-d9c9-40b2-bd9c-44dfd33ce39e', 'b88bda18-7520-4acf-ae3d-256029a9f5a0', '3b0435a2-2cd1-4729-acec-2f946e6a265b', '210c69a2-50ff-4f7b-a4a6-31747e7bec56'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:36 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:36:36 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:36 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4" returned: 0 in 0.527s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:36 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.info Apr 10 10:36:36 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:36 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.580s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Deleted volume successfully. Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7db8c236-2172-4cb5-934f-b4ad7faaf2bd tempest-VolumesGetTest-31708936 None] Lock "cinder-65f42f57-ad24-4e70-ad84-c2409e7c88e9-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Lock "cinder-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-quobyte-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f5d71d-d74e-46f8-b270-112b6adbc285]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:37 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.info" returned: 0 in 0.668s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:37 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.info is being set with open permissions: ugo+rw Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:37 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20 Apr 10 10:36:37 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:37 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.info Apr 10 10:36:37 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Flow 'volume_create_manager' (5f831c93-d82b-4556-9699-3d3aa768a562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080021c9-18ce-47ed-ad15-295066c6d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (080021c9-18ce-47ed-ad15-295066c6d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1604243438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d221059a-3759-4d56-b73c-dbd33a401907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d050ce98ff4d44a2949e67b7c2c398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:37Z,use_quota=True,user_id='432592eb4d0b43d7a22e962ed65f3506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff10838b-a414-4209-a12c-1d606ef9f4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff10838b-a414-4209-a12c-1d606ef9f4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2704d1d9-96a6-4664-b51f-fdf7d1bcb941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.image.glance [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Creating Keystone auth plugin from conf {{(pid=83037) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2704d1d9-96a6-4664-b51f-fdf7d1bcb941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd221059a-3759-4d56-b73c-dbd33a401907', 'volume_name': 'volume-d221059a-3759-4d56-b73c-dbd33a401907', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea7221e-59b6-41d8-a09b-342859451c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea7221e-59b6-41d8-a09b-342859451c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d9623d-9903-49d9-b2be-341c1d7d212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:37 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Volume d221059a-3759-4d56-b73c-dbd33a401907: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d221059a-3759-4d56-b73c-dbd33a401907', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Trying to clone d221059a-3759-4d56-b73c-dbd33a401907 from image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]). {{(pid=83037) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:36:37 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:36:37 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:36:37 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20" returned: 0 in 0.705s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.info" returned: 0 in 0.611s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.896s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:37 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20 Apr 10 10:36:37 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.344s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] Creating offline snapshot 0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f of volume 39a37c9c-53f4-4a8d-a5f2-2431222bc698 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ba477c2a-c5d1-4496-b1fc-cd0f78441e1a tempest-CreateVolumesFromSnapshotTest-221035917 None] Create snapshot completed successfully Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2780cb6-e5c6-4364-af74-27c07b15dac6]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[475ad165-0d73-4f64-a19e-ef16a8a8faaf]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:37 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD Apr 10 10:36:37 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:37 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 Apr 10 10:36:37 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:38 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20" returned: 0 in 0.545s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20" released by "delete_volume" :: held 1.280s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Created reservations ['4068eae0-6363-42b9-9671-c9563e11e48b', '5a4e2d9c-b030-4d7d-af73-52d14c62f658', 'b075717b-9e7c-458d-89a8-a4f8329f565a', 'b1ede900-fcdf-4268-8e5e-31ea48c146c6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:38 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD" returned: 0 in 0.605s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Temporary image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df is fetched for user 432592eb4d0b43d7a22e962ed65f3506. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:36:38 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:36:38 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:38 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698" returned: 0 in 0.646s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:38 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f 1G Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[33da000e-1f25-4eb8-a967-32a33a1f5cd7]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:38 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:38 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD Apr 10 10:36:38 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:39 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (39d2b397-7d22-4396-8b9c-25db46264ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79d1454-1f3e-43a4-862d-9202bfe527e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.652s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Deleted volume successfully. Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79d1454-1f3e-43a4-862d-9202bfe527e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-840647090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e15bff0-6a8c-4dda-96ff-5a17f8eed0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:39Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28770842-3d54-43ae-b025-0e336e76efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28770842-3d54-43ae-b025-0e336e76efe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70bcc0a-84fa-498b-927e-9e341369f961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70bcc0a-84fa-498b-927e-9e341369f961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e15bff0-6a8c-4dda-96ff-5a17f8eed0da', 'volume_name': 'volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54de7529-536d-4ba1-8acb-4b38c9052804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54de7529-536d-4ba1-8acb-4b38c9052804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b45ead1-dfc2-4cc6-912e-ed4866682574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume 0e15bff0-6a8c-4dda-96ff-5a17f8eed0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da', 'volume_size': 1} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f50e7637-2666-4b09-b1ce-e9414f28ddaa tempest-VolumesGetTest-31708936 None] Lock "cinder-6f56a9ba-5b85-42ca-9a1b-fc078e21fd20-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:39 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f 1G" returned: 0 in 0.742s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:39 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f Apr 10 10:36:39 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:39 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD" returned: 0 in 0.748s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (55cfcf8f-84dc-4763-b497-13ae80c92a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4154abfb-fd91-4039-8710-956145d99b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4154abfb-fd91-4039-8710-956145d99b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1930478386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d44c9c-3ab8-409a-a2c3-99d09e1d756f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:39Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a314782-2713-4232-b64e-c2273fb4cf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a314782-2713-4232-b64e-c2273fb4cf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797ede8f-35b9-4731-9b0a-8bccac5c4625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797ede8f-35b9-4731-9b0a-8bccac5c4625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d44c9c-3ab8-409a-a2c3-99d09e1d756f', 'volume_name': 'volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a0fa6d-28a0-4df8-b3ba-74b7f2c2b199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a0fa6d-28a0-4df8-b3ba-74b7f2c2b199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2d5077-e528-4e4f-9cbf-6774ed4d3d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume a6d44c9c-3ab8-409a-a2c3-99d09e1d756f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f', 'volume_size': 1} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (dc932a5d-5088-4d11-bf0a-ec024c2d68ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd88f71-245a-4d52-a7cd-98adcfefe60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd88f71-245a-4d52-a7cd-98adcfefe60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1707357435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504b24d9-7751-4907-a82e-dad9e71d8602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:40Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dab4b8-511d-4272-8626-31516c332d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16dab4b8-511d-4272-8626-31516c332d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abaa451-4ad3-4394-af5e-c4878df1f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abaa451-4ad3-4394-af5e-c4878df1f95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '504b24d9-7751-4907-a82e-dad9e71d8602', 'volume_name': 'volume-504b24d9-7751-4907-a82e-dad9e71d8602', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a5bc51-8236-4bad-8ad3-d772469ba364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a5bc51-8236-4bad-8ad3-d772469ba364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2c590e-b3bc-4e26-96a2-c3814e756fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Volume 504b24d9-7751-4907-a82e-dad9e71d8602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-504b24d9-7751-4907-a82e-dad9e71d8602', 'volume_size': 1} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (e296dae3-5a43-4584-b1e3-0bf76fe1fc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb113289-0e0d-498a-8536-bf8862218aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb113289-0e0d-498a-8536-bf8862218aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-360669310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90d16a7-2dd5-442d-ac54-6934cf58210b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:40Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca01a09-c7f6-4841-af68-fdb013a34782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca01a09-c7f6-4841-af68-fdb013a34782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb092c6-f6ca-4448-ba6d-613c90ff512e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb092c6-f6ca-4448-ba6d-613c90ff512e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b90d16a7-2dd5-442d-ac54-6934cf58210b', 'volume_name': 'volume-b90d16a7-2dd5-442d-ac54-6934cf58210b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbe1413-4126-450f-9c21-0c2febf792a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbe1413-4126-450f-9c21-0c2febf792a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402c8a7f-f376-4ca0-8719-8e16f64aa2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume b90d16a7-2dd5-442d-ac54-6934cf58210b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b90d16a7-2dd5-442d-ac54-6934cf58210b', 'volume_size': 1} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (ea53dc60-0525-4b80-ae93-1bbb74be2312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b171204c-f216-4cdc-b292-68f8b5f6d960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b171204c-f216-4cdc-b292-68f8b5f6d960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1794817548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd66244-2bdc-4367-a48c-cd50fb0feaa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:40Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67885083-94cd-45c0-ae88-cad544aefced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67885083-94cd-45c0-ae88-cad544aefced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526c1227-6caf-4ac0-95fd-b5655f63133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526c1227-6caf-4ac0-95fd-b5655f63133a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd66244-2bdc-4367-a48c-cd50fb0feaa6', 'volume_name': 'volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4534009b-e29e-48aa-a901-d444efaf4683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4534009b-e29e-48aa-a901-d444efaf4683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1f7a14-e6f1-454d-a508-5088089ea9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume 6bd66244-2bdc-4367-a48c-cd50fb0feaa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6', 'volume_size': 1} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f" returned: 0 in 0.722s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:39 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f is being set with open permissions: ugo+rw Apr 10 10:36:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:39 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f Apr 10 10:36:39 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (31111528-3eda-4c91-a4aa-df1bc5d8d92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7942fc9-be40-460a-b540-9f0c9231ea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7942fc9-be40-460a-b540-9f0c9231ea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847807056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e52494-6bce-462a-bbdf-1ac97d1dfd69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:40Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae0dee5-dedb-48c3-b976-b8e9cd8d075d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae0dee5-dedb-48c3-b976-b8e9cd8d075d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a1d5ab-1ce4-4453-ad95-cf5b7d28f2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a1d5ab-1ce4-4453-ad95-cf5b7d28f2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04e52494-6bce-462a-bbdf-1ac97d1dfd69', 'volume_name': 'volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c96bc8-b8e8-4e42-9e7d-4f2282449554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c96bc8-b8e8-4e42-9e7d-4f2282449554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b12c7f-e934-44cc-bd73-1ee7f0fb331d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume 04e52494-6bce-462a-bbdf-1ac97d1dfd69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69', 'volume_size': 1} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:40 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f" returned: 0 in 0.566s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:40 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.info Apr 10 10:36:40 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:41 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.info" returned: 0 in 0.520s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:41 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.info is being set with open permissions: ugo+rw Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:41 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.info Apr 10 10:36:41 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:41 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.info" returned: 0 in 0.488s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.787s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.417s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-840647090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e15bff0-6a8c-4dda-96ff-5a17f8eed0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:39Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Creating volume 0e15bff0-6a8c-4dda-96ff-5a17f8eed0da {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:41 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:41 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da 1073741824 Apr 10 10:36:41 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:41 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-cf0498a1-9538-484d-bcf6-dea04be8d0a8 req-1bd9de99-d679-479e-936e-027ada071eb6 tempest-VolumesSnapshotsTestJSON-79493321 None] Create snapshot completed successfully Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Acquiring lock "cinder-0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "cinder-0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Acquiring lock "cinder-quobyte-39a37c9c-53f4-4a8d-a5f2-2431222bc698" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "cinder-quobyte-39a37c9c-53f4-4a8d-a5f2-2431222bc698" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Acquiring lock "cinder-quobyte-0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "cinder-quobyte-0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Deleting offline snapshot 0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f of volume 39a37c9c-53f4-4a8d-a5f2-2431222bc698 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] snapshot_file for this snap is: volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce62f203-0561-4011-a08d-4e64285402f9]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:42 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da 1073741824" returned: 0 in 0.667s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:42 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da Apr 10 10:36:42 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:42 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f Apr 10 10:36:42 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:42 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da" returned: 0 in 0.452s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.493s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1604243438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d221059a-3759-4d56-b73c-dbd33a401907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d050ce98ff4d44a2949e67b7c2c398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:37Z,use_quota=True,user_id='432592eb4d0b43d7a22e962ed65f3506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Creating volume d221059a-3759-4d56-b73c-dbd33a401907 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:42 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b45ead1-dfc2-4cc6-912e-ed4866682574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:42 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 1073741824 Apr 10 10:36:42 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077ad268-94f6-476c-a45f-a9b9eff970e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:42 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da (0e15bff0-6a8c-4dda-96ff-5a17f8eed0da): created successfully Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077ad268-94f6-476c-a45f-a9b9eff970e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (39d2b397-7d22-4396-8b9c-25db46264ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:42 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-253d2bcc-3a8d-4655-88ed-25a3f5f4dde7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Created volume successfully. Apr 10 10:36:42 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f" returned: 0 in 0.626s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b4b273-00ab-4a08-89ba-ca93fd59a306]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:42 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 Apr 10 10:36:42 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:43 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698" returned: 0 in 0.577s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:43 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:43 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f Apr 10 10:36:43 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 1073741824" returned: 0 in 0.714s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:43 devstack sudo[88190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 Apr 10 10:36:43 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:44 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907" returned: 0 in 0.498s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.523s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1930478386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d44c9c-3ab8-409a-a2c3-99d09e1d756f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:39Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Creating volume a6d44c9c-3ab8-409a-a2c3-99d09e1d756f {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:44 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Attempting download of d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df ((None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}])) to volume d221059a-3759-4d56-b73c-dbd33a401907. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:36:44 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f 1073741824 Apr 10 10:36:44 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:44 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f" returned: 0 in 0.603s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:44 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f Apr 10 10:36:44 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a005b89-7f7d-411e-bfb6-671c3f160790]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_daky5o3a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:44 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_daky5o3a Apr 10 10:36:44 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:44 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698.0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f" returned: 0 in 0.523s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "cinder-quobyte-0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f" released by "_delete_snapshot" :: held 2.426s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "cinder-quobyte-39a37c9c-53f4-4a8d-a5f2-2431222bc698" released by "delete_snapshot" :: held 2.444s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:44 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f 1073741824" returned: 0 in 0.602s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:44 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f Apr 10 10:36:44 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG cinder.quota [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Created reservations ['09a82b73-216d-47e1-bb7e-6c58539c2377', '573a763c-520f-45d5-97fd-8ed974d036fa', '1187fdfb-106e-46f3-9c6a-0753c302983e', 'd7490ae7-8186-40b8-8092-d275fcbaf568'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:44 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_daky5o3a" returned: 0 in 0.620s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_daky5o3a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Delete snapshot completed successfully. Apr 10 10:36:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-910cb5ff-e209-4b28-a343-7b3f8dd925e8 req-f88a5d95-c21e-4f7a-8d18-5d943df47082 tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "cinder-0dfc02ab-1c47-4ed7-83e4-4c80a54aaa2f-delete_snapshot" released by "delete_snapshot" :: held 2.597s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:44 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_daky5o3a Apr 10 10:36:44 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:45 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f" returned: 0 in 0.507s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.476s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1707357435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504b24d9-7751-4907-a82e-dad9e71d8602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:40Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Creating volume 504b24d9-7751-4907-a82e-dad9e71d8602 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:45 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2d5077-e528-4e4f-9cbf-6774ed4d3d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92568d5-47a7-4dfc-a376-a87ee745a0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:45 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 1073741824 Apr 10 10:36:45 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f (a6d44c9c-3ab8-409a-a2c3-99d09e1d756f): created successfully Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92568d5-47a7-4dfc-a376-a87ee745a0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (55cfcf8f-84dc-4763-b497-13ae80c92a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6fdd0302-0348-4bf2-94e1-ff01a2381762 tempest-CreateVolumesFromSnapshotTest-221035917 None] Created volume successfully. Apr 10 10:36:45 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_daky5o3a" returned: 1 in 0.591s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_daky5o3a' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[57657e7f-9a81-4973-9fa2-4a1b2ed7f32f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:45 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD Apr 10 10:36:45 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Acquiring lock "cinder-39a37c9c-53f4-4a8d-a5f2-2431222bc698-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "cinder-39a37c9c-53f4-4a8d-a5f2-2431222bc698-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Acquiring lock "cinder-quobyte-39a37c9c-53f4-4a8d-a5f2-2431222bc698" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "cinder-quobyte-39a37c9c-53f4-4a8d-a5f2-2431222bc698" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9813c33a-74b2-4482-a143-2ec9b9b6c466]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:45 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 Apr 10 10:36:45 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:45 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 1073741824" returned: 0 in 0.685s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:45 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 Apr 10 10:36:45 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:46 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD" returned: 0 in 0.705s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df was qcow2, converting to raw {{(pid=83037) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:46 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 Apr 10 10:36:46 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:46 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698" returned: 0 in 0.601s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:46 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698 Apr 10 10:36:46 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:46 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602" returned: 0 in 0.599s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.687s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-360669310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90d16a7-2dd5-442d-ac54-6934cf58210b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:40Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Creating volume b90d16a7-2dd5-442d-ac54-6934cf58210b {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:46 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2c590e-b3bc-4e26-96a2-c3814e756fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-504b24d9-7751-4907-a82e-dad9e71d8602', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0c2fb1-e106-4b4c-9340-d659d3e6b6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:46 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b 1073741824 Apr 10 10:36:46 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Volume volume-504b24d9-7751-4907-a82e-dad9e71d8602 (504b24d9-7751-4907-a82e-dad9e71d8602): created successfully Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0c2fb1-e106-4b4c-9340-d659d3e6b6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (dc932a5d-5088-4d11-bf0a-ec024c2d68ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b3ba9663-bd43-4d8d-9972-f2db77deb58c tempest-VolumesGetTest-31708936 None] Created volume successfully. Apr 10 10:36:46 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-39a37c9c-53f4-4a8d-a5f2-2431222bc698" returned: 0 in 0.677s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "cinder-quobyte-39a37c9c-53f4-4a8d-a5f2-2431222bc698" released by "delete_volume" :: held 1.336s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:46 devstack cinder-volume[83037]: DEBUG cinder.quota [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Created reservations ['4396b2d5-ccb3-4710-8e73-03d90a9dfd6b', '3a802f2e-bff2-4188-ad70-e6910d3bb891', 'e34f64ed-8a98-4ad7-999e-2a3614856af1', '1ec429e6-11a1-4bf4-a836-ffac3cec36b6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:47 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:36:47 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:47 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907" returned: 0 in 1.168s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_6bkw99x6devstack@QuobyteHD, size 112.00 MB, duration 1.17 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:36:47 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Converted 112.00 MB image at 95.78 MB/s Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:47 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 1G Apr 10 10:36:47 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:47 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b 1073741824" returned: 0 in 0.730s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:47 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b Apr 10 10:36:47 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (969a6917-2039-42e5-9ffb-76a7a3e48c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3932e810-48a8-47f3-b2c0-fac0fc5a34fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3932e810-48a8-47f3-b2c0-fac0fc5a34fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1540069158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b78da0-676c-4d0d-a89d-fe14581c42bb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=504b24d9-7751-4907-a82e-dad9e71d8602,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:47Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a5af0e-b751-4cf2-bbe7-7ea466e1b068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a5af0e-b751-4cf2-bbe7-7ea466e1b068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e83331-e136-4938-9a76-24c5afcaa19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e83331-e136-4938-9a76-24c5afcaa19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '22b78da0-676c-4d0d-a89d-fe14581c42bb', 'volume_name': 'volume-22b78da0-676c-4d0d-a89d-fe14581c42bb', 'volume_size': 1, 'source_volid': '504b24d9-7751-4907-a82e-dad9e71d8602', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bad6e86-a1d8-4b68-8976-6fc038324bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bad6e86-a1d8-4b68-8976-6fc038324bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4732ab29-ee04-471f-b640-dd634a2bf03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Volume 22b78da0-676c-4d0d-a89d-fe14581c42bb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-22b78da0-676c-4d0d-a89d-fe14581c42bb', 'volume_size': 1, 'source_volid': '504b24d9-7751-4907-a82e-dad9e71d8602', 'source_volstatus': 'available'} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:47 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.660s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.manager [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:47 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Deleted volume successfully. Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-b5d97799-84ac-493c-93b6-a528e8dc56c5 req-53a75fee-6b5a-4ab5-9f96-498c26339bfa tempest-VolumesSnapshotsTestJSON-79493321 None] Lock "cinder-39a37c9c-53f4-4a8d-a5f2-2431222bc698-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:47 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 1G" returned: 0 in 0.652s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:47 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b" returned: 0 in 0.579s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.924s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1794817548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd66244-2bdc-4367-a48c-cd50fb0feaa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:40Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Creating volume 6bd66244-2bdc-4367-a48c-cd50fb0feaa6 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:47 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51f6b56-1d5a-42d9-98db-f6e73a2089f3]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:47 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6 1073741824 Apr 10 10:36:47 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402c8a7f-f376-4ca0-8719-8e16f64aa2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90d16a7-2dd5-442d-ac54-6934cf58210b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57fbda7-3d32-4622-a7a2-95f3e1e4c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume volume-b90d16a7-2dd5-442d-ac54-6934cf58210b (b90d16a7-2dd5-442d-ac54-6934cf58210b): created successfully Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57fbda7-3d32-4622-a7a2-95f3e1e4c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (e296dae3-5a43-4584-b1e3-0bf76fe1fc46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:47 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bb0ca4fd-1e49-47cc-9db4-7f5313d423d7 tempest-CreateVolumesFromSnapshotTest-221035917 None] Created volume successfully. Apr 10 10:36:48 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 Apr 10 10:36:48 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:48 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6 1073741824" returned: 0 in 0.650s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:48 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:48 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6 Apr 10 10:36:48 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907" returned: 0 in 0.700s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:48 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 Apr 10 10:36:48 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:49 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6" returned: 0 in 0.625s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.929s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1847807056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e52494-6bce-462a-bbdf-1ac97d1dfd69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d32c22b6a3664321a0c5aa5dcf1cb74a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:40Z,use_quota=True,user_id='87da02fbfaa24409bd05dcbb363f0b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Creating volume 04e52494-6bce-462a-bbdf-1ac97d1dfd69 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:49 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1f7a14-e6f1-454d-a508-5088089ea9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf843d6-e5eb-46ae-b18d-621529356f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69 1073741824 Apr 10 10:36:49 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:49 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6 (6bd66244-2bdc-4367-a48c-cd50fb0feaa6): created successfully Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf843d6-e5eb-46ae-b18d-621529356f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (ea53dc60-0525-4b80-ae93-1bbb74be2312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:49 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ec04afb7-7758-403b-97ba-6b0816451ed9 tempest-CreateVolumesFromSnapshotTest-221035917 None] Created volume successfully. Apr 10 10:36:49 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907" returned: 1 in 0.699s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Downloaded image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df ((None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}])) to volume d221059a-3759-4d56-b73c-dbd33a401907 successfully. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Temporary image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df for user 432592eb4d0b43d7a22e962ed65f3506 is deleted. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Marking volume d221059a-3759-4d56-b73c-dbd33a401907 as bootable. {{(pid=83037) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Copying metadata from image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df to d221059a-3759-4d56-b73c-dbd33a401907. {{(pid=83037) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Creating volume glance metadata for volume d221059a-3759-4d56-b73c-dbd33a401907 backed by image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83037) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d9623d-9903-49d9-b2be-341c1d7d212b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d221059a-3759-4d56-b73c-dbd33a401907', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbf00d3-bfdc-4c39-be5b-bd4ac0fa9190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Volume volume-d221059a-3759-4d56-b73c-dbd33a401907 (d221059a-3759-4d56-b73c-dbd33a401907): created successfully Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbf00d3-bfdc-4c39-be5b-bd4ac0fa9190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Flow 'volume_create_manager' (5f831c93-d82b-4556-9699-3d3aa768a562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:49 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6c7041ae-bbe6-4e04-8d37-ce48e9d69fbd tempest-VolumesExtendTest-1557961593 None] Created volume successfully. Apr 10 10:36:50 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69 1073741824" returned: 0 in 0.808s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:50 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69 Apr 10 10:36:50 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-373a4216-7931-4da7-b6dd-8550c318249f tempest-VolumesExtendTest-1557961593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:50 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69" returned: 0 in 0.560s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.021s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:50 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Cloning volume 504b24d9-7751-4907-a82e-dad9e71d8602 to volume 22b78da0-676c-4d0d-a89d-fe14581c42bb Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b12c7f-e934-44cc-bd73-1ee7f0fb331d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e7599a-5308-45d4-a3e6-5091d740e310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Volume volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69 (04e52494-6bce-462a-bbdf-1ac97d1dfd69): created successfully Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e7599a-5308-45d4-a3e6-5091d740e310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Flow 'volume_create_manager' (31111528-3eda-4c91-a4aa-df1bc5d8d92f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Creating offline snapshot f64a948c-6eaa-4698-9a21-997ee7e58389 of volume 504b24d9-7751-4907-a82e-dad9e71d8602 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-320d4114-e110-45aa-8205-9f8d9aa46580 tempest-CreateVolumesFromSnapshotTest-221035917 None] Created volume successfully. Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61d2d31-fa2a-418b-a44e-41af09caac46]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:50 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 Apr 10 10:36:50 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Flow 'volume_create_manager' (4b3cf7ab-8923-4cac-a45a-4c57b9f75dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2f349a-56eb-479e-9c34-af06d26cb298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2f349a-56eb-479e-9c34-af06d26cb298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1342253431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8604852b-b750-4794-bc0e-a0a7903e3f36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cd78a5d14884a34a328a1f9f247707e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:51Z,use_quota=True,user_id='f233c82eef274480b4a0b92bb71fe82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c173f0c-dfb2-4dc8-aba8-9995ac96da7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c173f0c-dfb2-4dc8-aba8-9995ac96da7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26864a7f-23d0-4824-948a-6ca61070c68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26864a7f-23d0-4824-948a-6ca61070c68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8604852b-b750-4794-bc0e-a0a7903e3f36', 'volume_name': 'volume-8604852b-b750-4794-bc0e-a0a7903e3f36', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d91017-d965-4d8e-a1cf-c7c52d26cd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d91017-d965-4d8e-a1cf-c7c52d26cd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8450d6f9-233b-4358-ab54-3d051b23e407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Volume 8604852b-b750-4794-bc0e-a0a7903e3f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8604852b-b750-4794-bc0e-a0a7903e3f36', 'volume_size': 1} Apr 10 10:36:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-04e52494-6bce-462a-bbdf-1ac97d1dfd69-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-04e52494-6bce-462a-bbdf-1ac97d1dfd69-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-quobyte-04e52494-6bce-462a-bbdf-1ac97d1dfd69" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-04e52494-6bce-462a-bbdf-1ac97d1dfd69" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:51 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65b6292-3faa-4962-b915-d4ee1d45682c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:51 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69 Apr 10 10:36:51 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:51 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602" returned: 0 in 0.696s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:51 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 1G Apr 10 10:36:51 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:51 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69" returned: 0 in 0.548s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:51 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69 Apr 10 10:36:51 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:52 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 1G" returned: 0 in 0.679s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-504b24d9-7751-4907-a82e-dad9e71d8602 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:52 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-504b24d9-7751-4907-a82e-dad9e71d8602 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 Apr 10 10:36:52 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:52 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04e52494-6bce-462a-bbdf-1ac97d1dfd69" returned: 0 in 0.566s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-04e52494-6bce-462a-bbdf-1ac97d1dfd69" released by "delete_volume" :: held 1.150s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Created reservations ['1b615941-aeff-44ae-b82e-3944fa3de015', '9cd947de-bb3f-4f08-9c57-33f2e5161dbe', 'c0e54e0a-a58d-477c-84c1-a220665d2cd7', 'b16b09c0-834b-4752-b743-9f5d696f435a'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:52 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:36:52 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:52 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-504b24d9-7751-4907-a82e-dad9e71d8602 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389" returned: 0 in 0.552s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:52 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 is being set with open permissions: ugo+rw Apr 10 10:36:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:52 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 Apr 10 10:36:52 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:53 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.570s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Deleted volume successfully. Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf57228f-e296-4e17-9fee-1dbc40cc6813 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-04e52494-6bce-462a-bbdf-1ac97d1dfd69-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:53 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389" returned: 0 in 0.556s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:53 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.info Apr 10 10:36:53 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-6bd66244-2bdc-4367-a48c-cd50fb0feaa6-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-6bd66244-2bdc-4367-a48c-cd50fb0feaa6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-quobyte-6bd66244-2bdc-4367-a48c-cd50fb0feaa6" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-6bd66244-2bdc-4367-a48c-cd50fb0feaa6" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5be94c-1a95-4bf2-8354-f9beacf3130a]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:53 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6 Apr 10 10:36:53 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:53 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.info" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:53 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.info is being set with open permissions: ugo+rw Apr 10 10:36:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:53 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.info Apr 10 10:36:53 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:54 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6" returned: 0 in 0.676s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:54 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6 Apr 10 10:36:54 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:54 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.info" returned: 0 in 0.677s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-quobyte-22b78da0-676c-4d0d-a89d-fe14581c42bb" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-22b78da0-676c-4d0d-a89d-fe14581c42bb" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] snapshot: f64a948c-6eaa-4698-9a21-997ee7e58389, volume: 22b78da0-676c-4d0d-a89d-fe14581c42bb, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd82f7c8-9314-40a4-aa61-acf649309783]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:54 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 Apr 10 10:36:54 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:54 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-6bd66244-2bdc-4367-a48c-cd50fb0feaa6" returned: 0 in 0.570s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-6bd66244-2bdc-4367-a48c-cd50fb0feaa6" released by "delete_volume" :: held 1.285s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=131,cinder:UPDATE=124,cinder:INSERT=48,cinder:DELETE=11 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=94,cinder:UPDATE=149,cinder:INSERT=29,cinder:DELETE=15 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Created reservations ['28d91a91-bed2-48f6-96e1-f6164857c8ae', '74208a8d-a2e9-445c-818e-da7f06ee83e1', 'fb20c1d0-9a63-424a-88c1-5ed744c47801', '045c9962-7a77-417d-8843-8ba6f0dfb36b'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:54 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:36:54 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:55 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389" returned: 0 in 0.580s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-504b24d9-7751-4907-a82e-dad9e71d8602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c29030-d4de-456e-9288-62411ea0df75]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:55 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 Apr 10 10:36:55 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:55 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.492s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Deleted volume successfully. Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-efcb3534-1d44-4e89-8d4b-07547fa27339 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-6bd66244-2bdc-4367-a48c-cd50fb0feaa6-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-b90d16a7-2dd5-442d-ac54-6934cf58210b-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-b90d16a7-2dd5-442d-ac54-6934cf58210b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-quobyte-b90d16a7-2dd5-442d-ac54-6934cf58210b" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-b90d16a7-2dd5-442d-ac54-6934cf58210b" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42e45f1-639b-412f-bf65-08c13ff5ae77]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:55 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b Apr 10 10:36:55 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:55 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602" returned: 0 in 0.576s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:36:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:55 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb Apr 10 10:36:55 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:56 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b" returned: 0 in 0.594s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:56 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b Apr 10 10:36:56 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:57 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b90d16a7-2dd5-442d-ac54-6934cf58210b" returned: 0 in 1.653s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-b90d16a7-2dd5-442d-ac54-6934cf58210b" released by "delete_volume" :: held 2.286s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Created reservations ['3a67b4ae-5222-48b7-9bea-1a4c1213dae1', 'd33f758d-4060-4ee8-9517-13902f353014', 'be75f66d-8d3e-445d-a128-9247264f9c13', '30fc761e-0b97-4780-9c8d-6b788193aadd'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:58 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:36:58 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:58 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb" returned: 0 in 2.760s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[497f2efe-4fff-4d00-a8f4-ab95b283967b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:58 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 Apr 10 10:36:58 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:58 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.721s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:58 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Deleted volume successfully. Apr 10 10:36:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0b33ba5f-59fd-4e57-9113-f5bfca473711 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-b90d16a7-2dd5-442d-ac54-6934cf58210b-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-quobyte-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b746f72-675e-4002-beb6-ef9378e6db78]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:59 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f Apr 10 10:36:59 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:59 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602" returned: 0 in 0.838s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602, size 1024.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:36:59 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Converted 1024.00 MB image at 370.75 MB/s Apr 10 10:36:59 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb is being set with open permissions: ugo+rw Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:59 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb Apr 10 10:36:59 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:59 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f" returned: 0 in 0.652s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:59 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f Apr 10 10:36:59 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:59 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb" returned: 0 in 0.568s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-22b78da0-676c-4d0d-a89d-fe14581c42bb" released by "_copy_volume_from_snapshot" :: held 5.393s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-quobyte-f64a948c-6eaa-4698-9a21-997ee7e58389" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-f64a948c-6eaa-4698-9a21-997ee7e58389" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Deleting offline snapshot f64a948c-6eaa-4698-9a21-997ee7e58389 of volume 504b24d9-7751-4907-a82e-dad9e71d8602 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] snapshot_file for this snap is: volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ba604d-c348-4517-9ea9-28f233497557]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:00 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 Apr 10 10:37:00 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:00 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f" returned: 0 in 0.594s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f" released by "delete_volume" :: held 1.291s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Created reservations ['88927192-6d16-4d18-b29b-a3688cf846ee', '4ba65aca-5805-4bcc-b96f-bc7e464950ba', '8f57dbaf-eaef-4a88-bc15-daf0e65b2935', 'f3052092-d2dd-4dd5-bedf-d48490d3dad0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:00 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:00 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:00 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389" returned: 0 in 0.647s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-504b24d9-7751-4907-a82e-dad9e71d8602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6549a5e9-dfd1-4bb8-8e1a-8aa580a4c6b0]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:00 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 Apr 10 10:37:00 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:01 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:01 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Deleted volume successfully. Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-eec3d85b-8092-45cb-8b16-910ac3d06689 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-a6d44c9c-3ab8-409a-a2c3-99d09e1d756f-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:01 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602" returned: 0 in 0.637s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-quobyte-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:01 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 Apr 10 10:37:01 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6626ed9f-b415-44fb-ac5e-11c0372c0ba5]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:01 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da Apr 10 10:37:01 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:01 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389" returned: 0 in 0.593s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:01 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389 Apr 10 10:37:01 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:01 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da" returned: 0 in 0.590s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:02 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da Apr 10 10:37:02 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:02 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602.f64a948c-6eaa-4698-9a21-997ee7e58389" returned: 0 in 0.481s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-f64a948c-6eaa-4698-9a21-997ee7e58389" released by "_delete_snapshot" :: held 2.424s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.853s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-373a4216-7931-4da7-b6dd-8550c318249f tempest-VolumesExtendTest-1557961593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 12.329s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4732ab29-ee04-471f-b640-dd634a2bf03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22b78da0-676c-4d0d-a89d-fe14581c42bb', 'volume_size': 1, 'source_volid': '504b24d9-7751-4907-a82e-dad9e71d8602', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:02 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92866853-0bb0-45db-b4d4-38e4d34fdeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da" returned: 0 in 0.531s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0e5d72-7067-44e1-ba18-7aa0798939ff]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-373a4216-7931-4da7-b6dd-8550c318249f tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:02 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Volume volume-22b78da0-676c-4d0d-a89d-fe14581c42bb (22b78da0-676c-4d0d-a89d-fe14581c42bb): created successfully Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92866853-0bb0-45db-b4d4-38e4d34fdeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (969a6917-2039-42e5-9ffb-76a7a3e48c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da" released by "delete_volume" :: held 1.189s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:02 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-50cb579a-33e2-4ad3-80af-80ac2efe2873 tempest-VolumesGetTest-31708936 None] Created volume successfully. Apr 10 10:37:02 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Created reservations ['1029cd8d-799b-4dd0-8749-e4861dd2322f', 'b7614590-2c70-43a9-add2-f3ecf1841aaa', '63f1ba28-25c7-4304-86e3-55c6e5aeee62', 'a3ad7454-ba89-41f7-b62e-beaa0805a5ee'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:02 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:02 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:02 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:03 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-373a4216-7931-4da7-b6dd-8550c318249f tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907" returned: 0 in 0.583s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-373a4216-7931-4da7-b6dd-8550c318249f tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:03 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.496s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:03 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Deleted volume successfully. Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-401a7c98-bcb9-482d-b1a7-6991f96c0849 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-0e15bff0-6a8c-4dda-96ff-5a17f8eed0da-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:03 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 Apr 10 10:37:03 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-86f97185-10bc-492b-a6ef-9fdef816e2d4-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-86f97185-10bc-492b-a6ef-9fdef816e2d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-quobyte-fa754abb-fcb1-4d82-a961-7a8303928f22" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-fa754abb-fcb1-4d82-a961-7a8303928f22" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-quobyte-86f97185-10bc-492b-a6ef-9fdef816e2d4" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-86f97185-10bc-492b-a6ef-9fdef816e2d4" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Deleting offline snapshot 86f97185-10bc-492b-a6ef-9fdef816e2d4 of volume fa754abb-fcb1-4d82-a961-7a8303928f22 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] snapshot_file for this snap is: volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bb92a4-b76a-4f6e-80b9-189632a71202]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:03 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 Apr 10 10:37:03 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:03 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-373a4216-7931-4da7-b6dd-8550c318249f tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907" returned: 1 in 0.617s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-373a4216-7931-4da7-b6dd-8550c318249f tempest-VolumesExtendTest-1557961593 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-373a4216-7931-4da7-b6dd-8550c318249f tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 2G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-373a4216-7931-4da7-b6dd-8550c318249f tempest-VolumesExtendTest-1557961593 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 2G" returned: 0 in 0.088s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-373a4216-7931-4da7-b6dd-8550c318249f tempest-VolumesExtendTest-1557961593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.355s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.847s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1342253431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8604852b-b750-4794-bc0e-a0a7903e3f36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cd78a5d14884a34a328a1f9f247707e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:51Z,use_quota=True,user_id='f233c82eef274480b4a0b92bb71fe82d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Creating volume 8604852b-b750-4794-bc0e-a0a7903e3f36 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:03 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:03 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36 1073741824 Apr 10 10:37:03 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:03 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-373a4216-7931-4da7-b6dd-8550c318249f tempest-VolumesExtendTest-1557961593 None] Extend volume completed successfully. Apr 10 10:37:04 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4" returned: 0 in 0.669s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa754abb-fcb1-4d82-a961-7a8303928f22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Acquiring lock "cinder-d221059a-3759-4d56-b73c-dbd33a401907-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2d510c-a680-4082-a973-a99b0852f835]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Lock "cinder-d221059a-3759-4d56-b73c-dbd33a401907-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (f20cd903-8a3f-4b95-b543-251b4338f03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44018ea6-5687-4749-a7f4-ded8fbddc93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:04 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 Apr 10 10:37:04 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Acquiring lock "cinder-quobyte-d221059a-3759-4d56-b73c-dbd33a401907" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44018ea6-5687-4749-a7f4-ded8fbddc93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-605551666',display_name='tempest-VolumesGetTest-Volume-408906738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0bc125-a7c8-4e51-88fa-66b0bd3262f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:04Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637f530c-463f-4843-8477-a38626c389fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637f530c-463f-4843-8477-a38626c389fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9bc732-e75a-496e-ac65-1bac7e780f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9bc732-e75a-496e-ac65-1bac7e780f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0bc125-a7c8-4e51-88fa-66b0bd3262f0', 'volume_name': 'volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd69fdd6-ee24-444d-8bc9-81dc8f905bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd69fdd6-ee24-444d-8bc9-81dc8f905bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c45e874-175f-429c-9c43-ae74dd44c3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:04 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Volume af0bc125-a7c8-4e51-88fa-66b0bd3262f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0', 'volume_size': 1} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Lock "cinder-quobyte-d221059a-3759-4d56-b73c-dbd33a401907" acquired by "delete_volume" :: waited 0.064s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac1e811-310d-4adc-959c-7206c9f5df3b]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:04 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36 1073741824" returned: 0 in 0.776s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:04 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 Apr 10 10:37:04 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:04 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36 Apr 10 10:37:04 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:04 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22" returned: 0 in 0.628s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:04 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 Apr 10 10:37:04 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907" returned: 0 in 0.612s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:05 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36" returned: 0 in 0.554s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-605551666',display_name='tempest-VolumesGetTest-Volume-408906738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0bc125-a7c8-4e51-88fa-66b0bd3262f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:04Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Creating volume af0bc125-a7c8-4e51-88fa-66b0bd3262f0 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:05 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8450d6f9-233b-4358-ab54-3d051b23e407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8604852b-b750-4794-bc0e-a0a7903e3f36', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c8f7ab-476b-46b5-ad76-515534305ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:05 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0 1073741824 Apr 10 10:37:05 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 Apr 10 10:37:05 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Volume volume-8604852b-b750-4794-bc0e-a0a7903e3f36 (8604852b-b750-4794-bc0e-a0a7903e3f36): created successfully Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c8f7ab-476b-46b5-ad76-515534305ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Flow 'volume_create_manager' (4b3cf7ab-8923-4cac-a45a-4c57b9f75dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-8382fe0b-360b-4efa-bbf9-250c8c4dc941 req-4e187a5f-14b2-4680-b9a0-67bc55ee9a74 tempest-VolumesGetTestJSON-1208194686 None] Created volume successfully. Apr 10 10:37:05 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4" returned: 0 in 0.626s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:05 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4 Apr 10 10:37:05 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0 1073741824" returned: 0 in 0.617s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:05 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907" returned: 1 in 0.692s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:05 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907 Apr 10 10:37:05 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:05 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0 Apr 10 10:37:05 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:06 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22.86f97185-10bc-492b-a6ef-9fdef816e2d4" returned: 0 in 0.569s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-86f97185-10bc-492b-a6ef-9fdef816e2d4" released by "_delete_snapshot" :: held 2.598s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-fa754abb-fcb1-4d82-a961-7a8303928f22" released by "delete_snapshot" :: held 2.612s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Created reservations ['df7d5b7f-135e-4154-a48b-98be22f85203', '8a3d88e4-adf3-4be1-9bd1-a061dfab1922', '69536acd-7bb1-4dbe-8f87-b1624238d72f', '2d410a30-7f0f-4a77-8e6e-47c762502a80'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Delete snapshot completed successfully. Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d35af779-33f9-4fb2-bdc4-ebf2378131bf tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-86f97185-10bc-492b-a6ef-9fdef816e2d4-delete_snapshot" released by "delete_snapshot" :: held 2.746s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:06 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0" returned: 0 in 0.488s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c45e874-175f-429c-9c43-ae74dd44c3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a78239-8bc7-4045-bb19-eb46e3a3992f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:06 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Volume volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0 (af0bc125-a7c8-4e51-88fa-66b0bd3262f0): created successfully Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a78239-8bc7-4045-bb19-eb46e3a3992f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (f20cd903-8a3f-4b95-b543-251b4338f03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d221059a-3759-4d56-b73c-dbd33a401907" returned: 0 in 0.560s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8f156087-90c6-4a95-a670-c8313c48d1a0 tempest-VolumesGetTest-31708936 None] Created volume successfully. Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Lock "cinder-quobyte-d221059a-3759-4d56-b73c-dbd33a401907" released by "delete_volume" :: held 1.919s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Acquiring lock "cinder-8604852b-b750-4794-bc0e-a0a7903e3f36-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Lock "cinder-8604852b-b750-4794-bc0e-a0a7903e3f36-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Acquiring lock "cinder-quobyte-8604852b-b750-4794-bc0e-a0a7903e3f36" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Created reservations ['fdd05d66-b51c-4cfb-ba6f-526556268170', '6d6b2e52-e153-48d8-ba00-033f51658da2', '5c0d5d84-3019-4691-8eb3-bcb94cdb9ab8', '1b21eb8d-6a8e-407f-a25c-2066719d8960'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Lock "cinder-quobyte-8604852b-b750-4794-bc0e-a0a7903e3f36" acquired by "delete_volume" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5810f68-dcb4-474b-b80f-212d33363fa0]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:06 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36 Apr 10 10:37:06 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:06 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:06 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-fa754abb-fcb1-4d82-a961-7a8303928f22-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-fa754abb-fcb1-4d82-a961-7a8303928f22-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "cinder-quobyte-fa754abb-fcb1-4d82-a961-7a8303928f22" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-fa754abb-fcb1-4d82-a961-7a8303928f22" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e36643a-39b9-4ff7-b94a-1226229ec93c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:06 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 Apr 10 10:37:06 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:07 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.490s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Deleted volume successfully. Apr 10 10:37:07 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36" returned: 0 in 0.587s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-925d5880-780f-489f-bb01-c54a85f67b18 tempest-VolumesExtendTest-1557961593 None] Lock "cinder-d221059a-3759-4d56-b73c-dbd33a401907-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:07 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36 Apr 10 10:37:07 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:07 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22" returned: 0 in 0.689s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:07 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22 Apr 10 10:37:07 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:07 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8604852b-b750-4794-bc0e-a0a7903e3f36" returned: 0 in 0.527s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Lock "cinder-quobyte-8604852b-b750-4794-bc0e-a0a7903e3f36" released by "delete_volume" :: held 1.145s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-af0bc125-a7c8-4e51-88fa-66b0bd3262f0-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Lock "cinder-af0bc125-a7c8-4e51-88fa-66b0bd3262f0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG cinder.quota [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Created reservations ['3384fbb6-8f78-41b9-a317-3bdaa383e689', '3d2d0d03-d183-42ae-9dea-7aa68d3153fb', 'e3ea3d9b-e581-46b9-b7e7-f3e39a122ad8', '599109ba-ad63-4502-b35d-db91ab0f94c7'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-quobyte-af0bc125-a7c8-4e51-88fa-66b0bd3262f0" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-af0bc125-a7c8-4e51-88fa-66b0bd3262f0" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc87742-cca7-4c9e-a40c-c2d08262deae]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:07 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0 Apr 10 10:37:07 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:07 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:07 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Flow 'volume_create_manager' (334bd2be-6903-48cc-8142-9d67e0383941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ad8ce2-ed42-4ca9-8265-91e73fa68e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ad8ce2-ed42-4ca9-8265-91e73fa68e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-718041702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ca5ec6-cc89-4a69-8f81-9177c55e357e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d050ce98ff4d44a2949e67b7c2c398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:08Z,use_quota=True,user_id='432592eb4d0b43d7a22e962ed65f3506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2934141d-119a-47f1-ba91-2de69a3eb0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2934141d-119a-47f1-ba91-2de69a3eb0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef3dab6-4c37-4d59-95bd-8abf54cac002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef3dab6-4c37-4d59-95bd-8abf54cac002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2ca5ec6-cc89-4a69-8f81-9177c55e357e', 'volume_name': 'volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:08 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0640a30-7df4-4fa8-8870-0b2650ea3948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0640a30-7df4-4fa8-8870-0b2650ea3948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d5ce0e-4b5d-47d7-8165-9ce4ae843fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:08 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Volume c2ca5ec6-cc89-4a69-8f81-9177c55e357e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e', 'volume_size': 1} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-718041702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ca5ec6-cc89-4a69-8f81-9177c55e357e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d050ce98ff4d44a2949e67b7c2c398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:08Z,use_quota=True,user_id='432592eb4d0b43d7a22e962ed65f3506',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Creating volume c2ca5ec6-cc89-4a69-8f81-9177c55e357e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:08 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-fa754abb-fcb1-4d82-a961-7a8303928f22" returned: 0 in 0.603s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:08 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e 1073741824 Apr 10 10:37:08 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-quobyte-fa754abb-fcb1-4d82-a961-7a8303928f22" released by "delete_volume" :: held 1.334s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Created reservations ['cd873145-0692-4084-b074-91b3eee9229d', '19bdfb5c-a582-4091-bb08-7cc2b230d4eb', 'f3371273-66bd-4be2-9c80-8784bce8293d', 'bd989151-76cf-483d-80fd-ce53d8a78d05'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:08 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:08 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:08 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0" returned: 0 in 0.646s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:08 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0 Apr 10 10:37:08 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:08 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.628s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.manager [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Deleted volume successfully. Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [req-94f03b0e-0e55-4338-8ea3-72255ee0209a req-e5a99098-53a0-4f01-892d-a0470d99d940 tempest-VolumesGetTestJSON-1208194686 None] Lock "cinder-8604852b-b750-4794-bc0e-a0a7903e3f36-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:08 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e 1073741824" returned: 0 in 0.596s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:08 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e Apr 10 10:37:08 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:08 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.571s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Deleted volume successfully. Apr 10 10:37:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-fea9a09c-8704-44db-9ca5-74d1a46c7e95 tempest-CreateVolumesFromSnapshotTest-221035917 None] Lock "cinder-fa754abb-fcb1-4d82-a961-7a8303928f22-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:09 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-af0bc125-a7c8-4e51-88fa-66b0bd3262f0" returned: 0 in 0.632s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-af0bc125-a7c8-4e51-88fa-66b0bd3262f0" released by "delete_volume" :: held 1.307s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Created reservations ['1045ff23-1fb2-4d48-bcb8-bff292e6d9ee', '9898cfd5-6d03-4c2b-8285-bbb0e9533044', '68505e34-a5dc-4acf-b291-232dd3a9dcac', 'ea856ab0-af7f-45e3-aa40-38f27ed8e950'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:09 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:09 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:09 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" returned: 0 in 0.601s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d5ce0e-4b5d-47d7-8165-9ce4ae843fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5de482-7092-47ad-a2dd-4a9ef697046e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Volume volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e (c2ca5ec6-cc89-4a69-8f81-9177c55e357e): created successfully Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5de482-7092-47ad-a2dd-4a9ef697046e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Flow 'volume_create_manager' (334bd2be-6903-48cc-8142-9d67e0383941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0f73efbd-db0e-4210-92e3-c25c9c44d9b7 tempest-VolumesExtendTest-1557961593 None] Created volume successfully. Apr 10 10:37:09 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.576s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Deleted volume successfully. Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-28695aa2-084e-4d21-a1e3-448eb4945d95 tempest-VolumesGetTest-31708936 None] Lock "cinder-af0bc125-a7c8-4e51-88fa-66b0bd3262f0-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-22b78da0-676c-4d0d-a89d-fe14581c42bb-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Lock "cinder-22b78da0-676c-4d0d-a89d-fe14581c42bb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-quobyte-22b78da0-676c-4d0d-a89d-fe14581c42bb" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-22b78da0-676c-4d0d-a89d-fe14581c42bb" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e00bd61-e348-4a01-b995-1df378c34652]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:10 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb Apr 10 10:37:10 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] Creating offline snapshot 7a81c89c-0839-4c3c-8e78-e7b6adfab58a of volume c2ca5ec6-cc89-4a69-8f81-9177c55e357e {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9300387-d84b-4716-80aa-0b864426a585]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:10 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e Apr 10 10:37:10 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:10 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb" returned: 0 in 0.757s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:10 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb Apr 10 10:37:10 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:11 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" returned: 0 in 0.714s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:11 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a 1G Apr 10 10:37:11 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:11 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-22b78da0-676c-4d0d-a89d-fe14581c42bb" returned: 0 in 0.627s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-22b78da0-676c-4d0d-a89d-fe14581c42bb" released by "delete_volume" :: held 1.432s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Created reservations ['e9f777d2-3259-44b4-b53f-f96aa9374e61', 'c9799253-ae00-485e-b7f1-9eaea86e0a7e', 'fb9908e6-49bf-4184-821f-2f1c9f64e4ef', '75e3f64e-5575-41f4-bb84-0b985b7ff315'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:11 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:11 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:11 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a 1G" returned: 0 in 0.760s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:11 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a Apr 10 10:37:11 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (8e8392a9-eff0-4dbf-8eb8-951cf01df7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bffe2a-304a-4a1b-8923-c8530709e6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bffe2a-304a-4a1b-8923-c8530709e6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1535732064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dd35f6-56fb-45c7-803d-4a7ce141eb11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:12Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cfe5b8-88ef-42ff-8a1b-93cddc11fd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cfe5b8-88ef-42ff-8a1b-93cddc11fd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9721180-6122-45b0-8fa0-01a8b003dd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9721180-6122-45b0-8fa0-01a8b003dd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3dd35f6-56fb-45c7-803d-4a7ce141eb11', 'volume_name': 'volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db97fa2-8e6c-4455-a40b-1049a89e1a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db97fa2-8e6c-4455-a40b-1049a89e1a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475c6e7a-969c-4856-af72-d4baed1b42c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:12 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume b3dd35f6-56fb-45c7-803d-4a7ce141eb11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11', 'volume_size': 1} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:12 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.598s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Deleted volume successfully. Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cac6905a-e7e7-4f84-a9b1-26195926901d tempest-VolumesGetTest-31708936 None] Lock "cinder-22b78da0-676c-4d0d-a89d-fe14581c42bb-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-504b24d9-7751-4907-a82e-dad9e71d8602-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Lock "cinder-504b24d9-7751-4907-a82e-dad9e71d8602-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-quobyte-504b24d9-7751-4907-a82e-dad9e71d8602" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-504b24d9-7751-4907-a82e-dad9e71d8602" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de87fd8-fb26-4aa7-a3f3-59b3b24e39a7]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:12 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 Apr 10 10:37:12 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:12 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a" returned: 0 in 0.732s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:12 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a is being set with open permissions: ugo+rw Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:12 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a Apr 10 10:37:12 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:12 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602" returned: 0 in 0.610s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:12 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602 Apr 10 10:37:12 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:13 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a" returned: 0 in 0.607s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:13 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.info Apr 10 10:37:13 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:13 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-504b24d9-7751-4907-a82e-dad9e71d8602" returned: 0 in 0.605s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-504b24d9-7751-4907-a82e-dad9e71d8602" released by "delete_volume" :: held 1.273s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Created reservations ['9cbaf629-680f-4556-b771-deabeffa6c82', '6e728c9b-265f-4dcb-bc9a-da8e5dea94f8', '364e1bdd-04bd-4e9f-aa55-1f73a73f336e', '69eba5b2-919c-459d-905f-d6ad2800fb19'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:13 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:13 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:13 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.info" returned: 0 in 0.699s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:13 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.info is being set with open permissions: ugo+rw Apr 10 10:37:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:14 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.info Apr 10 10:37:14 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:14 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.681s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Deleted volume successfully. Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-10784860-d996-4a59-991d-9ea1cd45d0f6 tempest-VolumesGetTest-31708936 None] Lock "cinder-504b24d9-7751-4907-a82e-dad9e71d8602-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:14 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.info" returned: 0 in 0.828s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.428s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.634s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1535732064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dd35f6-56fb-45c7-803d-4a7ce141eb11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:12Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Creating volume b3dd35f6-56fb-45c7-803d-4a7ce141eb11 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:14 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-edbf5c7c-a764-403f-a393-5888a346bd4b tempest-VolumesExtendTest-1557961593 None] Create snapshot completed successfully Apr 10 10:37:14 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11 1073741824 Apr 10 10:37:14 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (ce839aae-45bc-4822-9e8f-5d1f8981a240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0461ad12-1905-4947-a5fc-653e4ff5fc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0461ad12-1905-4947-a5fc-653e4ff5fc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-310811915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:15Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf35346-7b3d-48ba-a2cb-04a981b468eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf35346-7b3d-48ba-a2cb-04a981b468eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2886e1a-f3a9-4a32-86be-34c3bfe99c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.image.glance [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Creating Keystone auth plugin from conf {{(pid=83037) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2886e1a-f3a9-4a32-86be-34c3bfe99c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2', 'volume_name': 'volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31da18e-a888-4213-bd98-c4f1717c98cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31da18e-a888-4213-bd98-c4f1717c98cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6ff5b4-21e2-4a39-8259-604477550f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:15 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Volume 2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Trying to clone 2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 from image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df at location (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]). {{(pid=83037) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:37:15 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eccc29d9-cc3d-49eb-8c93-8fa701444e23 tempest-VolumesExtendTest-1557961593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e301a7-2a70-445b-8a99-855e8f42801a]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:15 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11 1073741824" returned: 0 in 0.993s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:15 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11 Apr 10 10:37:15 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:15 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD Apr 10 10:37:15 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:16 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD" returned: 0 in 0.618s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Temporary image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df is fetched for user cf2dcc01ff5a43a78a3fb76bd1d99da6. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eed435-7f1c-4179-bd61-7e91ef4b4b2f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:16 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11" returned: 0 in 0.677s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eccc29d9-cc3d-49eb-8c93-8fa701444e23 tempest-VolumesExtendTest-1557961593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.768s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475c6e7a-969c-4856-af72-d4baed1b42c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c21cc7-1e34-4a45-92c8-ab0c7b98cc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0ef6c0-f87f-425d-8213-7ba134ca33cf]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:16 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eccc29d9-cc3d-49eb-8c93-8fa701444e23 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:16 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:16 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11 (b3dd35f6-56fb-45c7-803d-4a7ce141eb11): created successfully Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c21cc7-1e34-4a45-92c8-ab0c7b98cc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (8e8392a9-eff0-4dbf-8eb8-951cf01df7b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d704dda9-57b1-44c4-afff-9bb696cc836e tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created volume successfully. Apr 10 10:37:16 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e Apr 10 10:37:16 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:17 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD" returned: 0 in 0.579s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:17 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eccc29d9-cc3d-49eb-8c93-8fa701444e23 tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" returned: 0 in 0.732s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eccc29d9-cc3d-49eb-8c93-8fa701444e23 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a 2G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-eccc29d9-cc3d-49eb-8c93-8fa701444e23 tempest-VolumesExtendTest-1557961593 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a 2G" returned: 0 in 0.100s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-eccc29d9-cc3d-49eb-8c93-8fa701444e23 tempest-VolumesExtendTest-1557961593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.865s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-310811915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:15Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Creating volume 2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:17 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:17 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 1073741824 Apr 10 10:37:17 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-eccc29d9-cc3d-49eb-8c93-8fa701444e23 tempest-VolumesExtendTest-1557961593 None] Extend volume completed successfully. Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (156af5c9-a56b-4446-853c-4e4273a8015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ffa7f01-dda8-416a-b492-0d6749ba5d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ffa7f01-dda8-416a-b492-0d6749ba5d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2096277823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0637444-534b-4993-b59f-5abf68123e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:18Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9474d95-d7cc-4ef5-b06d-1145852e9041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9474d95-d7cc-4ef5-b06d-1145852e9041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3cf2cc-bc9e-4228-a6b9-3bce057746a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3cf2cc-bc9e-4228-a6b9-3bce057746a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0637444-534b-4993-b59f-5abf68123e0b', 'volume_name': 'volume-c0637444-534b-4993-b59f-5abf68123e0b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3d70c7-f9a5-47be-82cc-243a18b2bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3d70c7-f9a5-47be-82cc-243a18b2bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5e95f2-da3a-4153-bd8c-17bd84d0ac46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:18 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume c0637444-534b-4993-b59f-5abf68123e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0637444-534b-4993-b59f-5abf68123e0b', 'volume_size': 1} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Acquiring lock "cinder-7a81c89c-0839-4c3c-8e78-e7b6adfab58a-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:18 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 1073741824" returned: 0 in 0.767s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Lock "cinder-7a81c89c-0839-4c3c-8e78-e7b6adfab58a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Acquiring lock "cinder-quobyte-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Lock "cinder-quobyte-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Acquiring lock "cinder-quobyte-7a81c89c-0839-4c3c-8e78-e7b6adfab58a" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Lock "cinder-quobyte-7a81c89c-0839-4c3c-8e78-e7b6adfab58a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Deleting offline snapshot 7a81c89c-0839-4c3c-8e78-e7b6adfab58a of volume c2ca5ec6-cc89-4a69-8f81-9177c55e357e {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] snapshot_file for this snap is: volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c055d95a-de3a-4ca1-8f75-05fb78affa0b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:18 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a Apr 10 10:37:18 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:18 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 Apr 10 10:37:18 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (17d2f424-f014-48e9-9905-297313bfa2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d05665-2798-4df1-8358-d66306fc0ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d05665-2798-4df1-8358-d66306fc0ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-645515179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5952c06-619b-4f88-8bc7-5afdc91db8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:18Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60315f7b-3eff-432e-9e21-12a24acff759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60315f7b-3eff-432e-9e21-12a24acff759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eed462a-7e01-46f9-92e0-4c73fd7b3862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eed462a-7e01-46f9-92e0-4c73fd7b3862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5952c06-619b-4f88-8bc7-5afdc91db8d8', 'volume_name': 'volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f53cb8b-da5f-4c79-857a-671895cdd0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f53cb8b-da5f-4c79-857a-671895cdd0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f3c3a9-0d94-49fe-9281-743832f84455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:18 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume f5952c06-619b-4f88-8bc7-5afdc91db8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8', 'volume_size': 1} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (d538c81d-7f71-47c3-8f04-7727de50c1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c688790e-e52b-48be-878a-a4b0921776cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c688790e-e52b-48be-878a-a4b0921776cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729036564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a8c6ce-335f-4c1f-8a17-9665e2b4422c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:19Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3db4ec0-98d8-43f7-927c-f5cc2344498c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3db4ec0-98d8-43f7-927c-f5cc2344498c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4694bfd9-2df4-43fb-bf85-4c99832d122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4694bfd9-2df4-43fb-bf85-4c99832d122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6a8c6ce-335f-4c1f-8a17-9665e2b4422c', 'volume_name': 'volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efad210e-9ad9-40a9-8041-a6a13f9b344c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efad210e-9ad9-40a9-8041-a6a13f9b344c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5fd2a5-fe7b-48df-9dd8-ed03c2c070b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume e6a8c6ce-335f-4c1f-8a17-9665e2b4422c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c', 'volume_size': 1} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:19 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a" returned: 0 in 0.823s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[be15ba70-9439-4631-8e8e-2023a7f89c53]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (a6af043b-ec9f-4d08-aa71-78d79a5d3c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b2d7ca-b064-4bd2-bf74-d06cfc0f6786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:19 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e Apr 10 10:37:19 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b2d7ca-b064-4bd2-bf74-d06cfc0f6786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056608490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1852e512-9c0a-4049-82e6-dc3256340763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:19Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2527f60-e168-40e3-ac14-27909f3ef568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2527f60-e168-40e3-ac14-27909f3ef568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2f7513-0386-458e-9f79-9a3a4e64ca61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2f7513-0386-458e-9f79-9a3a4e64ca61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1852e512-9c0a-4049-82e6-dc3256340763', 'volume_name': 'volume-1852e512-9c0a-4049-82e6-dc3256340763', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d79bbef-431b-4a61-af10-f51300616fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d79bbef-431b-4a61-af10-f51300616fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190ebd9b-6924-4b48-82b2-7e13724cf459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume 1852e512-9c0a-4049-82e6-dc3256340763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1852e512-9c0a-4049-82e6-dc3256340763', 'volume_size': 1} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2" returned: 0 in 0.829s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.317s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2096277823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0637444-534b-4993-b59f-5abf68123e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:18Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Creating volume c0637444-534b-4993-b59f-5abf68123e0b {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:19 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Attempting download of d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df ((None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}])) to volume 2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:37:19 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b 1073741824 Apr 10 10:37:19 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d206857-8ac8-4cc0-8d5d-520cead03689]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_z12jvok4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:19 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_z12jvok4 Apr 10 10:37:19 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (7be7c478-e45a-4927-b303-b1915be30449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2094a922-8af4-44f2-ab34-cba266a12bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2094a922-8af4-44f2-ab34-cba266a12bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1379659452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fbeb42-fc97-4623-8840-e3ae1fa59ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:19Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae939ab-25d9-42d4-84a3-8cfa3f73bc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae939ab-25d9-42d4-84a3-8cfa3f73bc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a94738-44e6-4625-8292-418bfdc84b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a94738-44e6-4625-8292-418bfdc84b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73fbeb42-fc97-4623-8840-e3ae1fa59ac1', 'volume_name': 'volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075b7341-b55a-412d-8066-6e5076190981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075b7341-b55a-412d-8066-6e5076190981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906bef7b-f835-4244-955e-35f2e2be1f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume 73fbeb42-fc97-4623-8840-e3ae1fa59ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1', 'volume_size': 1} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Flow 'volume_create_manager' (2f45316a-0818-428e-8d90-6582ef5fab93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d213131b-9a7f-42d3-b333-50da09deb8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d213131b-9a7f-42d3-b333-50da09deb8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-93510312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64300397-1433-438a-9857-9eac9c454334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcfa95313e14f6c8846686565bdf29d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:20Z,use_quota=True,user_id='18812190024a4315ae554408fb18e4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8217fa-98a9-4eec-8fb1-dae6a6e1c070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8217fa-98a9-4eec-8fb1-dae6a6e1c070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1565c5d3-b17d-4265-88b0-7021aae2bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1565c5d3-b17d-4265-88b0-7021aae2bce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64300397-1433-438a-9857-9eac9c454334', 'volume_name': 'volume-64300397-1433-438a-9857-9eac9c454334', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0cf75b-65fa-4de4-9358-c36e6cf70a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0cf75b-65fa-4de4-9358-c36e6cf70a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:19 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b65d72-4799-4182-84ad-e73ced7aae9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:19 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Volume 64300397-1433-438a-9857-9eac9c454334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64300397-1433-438a-9857-9eac9c454334', 'volume_size': 1} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" returned: 0 in 0.716s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:19 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a Apr 10 10:37:19 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:20 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b 1073741824" returned: 0 in 0.766s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:20 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_z12jvok4" returned: 0 in 0.667s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_z12jvok4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:20 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b Apr 10 10:37:20 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:20 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_z12jvok4 Apr 10 10:37:20 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:20 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a" returned: 0 in 0.625s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:20 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a Apr 10 10:37:20 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:20 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_z12jvok4" returned: 1 in 0.554s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_z12jvok4' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a6a507-a292-4257-bd8e-9276931b0759]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:20 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b" returned: 0 in 0.563s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-645515179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5952c06-619b-4f88-8bc7-5afdc91db8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:18Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Creating volume f5952c06-619b-4f88-8bc7-5afdc91db8d8 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:20 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:20 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD Apr 10 10:37:20 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5e95f2-da3a-4153-bd8c-17bd84d0ac46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0637444-534b-4993-b59f-5abf68123e0b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c56751a-5cb2-474f-a16f-8fa9a9279908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:20 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8 1073741824 Apr 10 10:37:20 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:20 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume volume-c0637444-534b-4993-b59f-5abf68123e0b (c0637444-534b-4993-b59f-5abf68123e0b): created successfully Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c56751a-5cb2-474f-a16f-8fa9a9279908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (156af5c9-a56b-4446-853c-4e4273a8015a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-31072ddf-2a62-4dc3-996b-bad76dd21ed3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created volume successfully. Apr 10 10:37:21 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e.7a81c89c-0839-4c3c-8e78-e7b6adfab58a" returned: 0 in 0.641s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Lock "cinder-quobyte-7a81c89c-0839-4c3c-8e78-e7b6adfab58a" released by "_delete_snapshot" :: held 2.877s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Lock "cinder-quobyte-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" released by "delete_snapshot" :: held 2.898s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Created reservations ['99633cf0-9914-4dfc-8526-180e73919dd3', '17c5e051-2a9e-4123-8a8f-a378c22a6f1c', 'ce3edcaf-f445-4e91-abbe-ab95fa1f1c27', 'b978fbbc-513a-4850-9be5-8bca583eff2e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Delete snapshot completed successfully. Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-013434bf-fa65-48cf-ae30-9e568b61b2a5 tempest-VolumesExtendTest-1557961593 None] Lock "cinder-7a81c89c-0839-4c3c-8e78-e7b6adfab58a-delete_snapshot" released by "delete_snapshot" :: held 3.029s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:21 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD" returned: 0 in 0.589s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df was qcow2, converting to raw {{(pid=83037) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:21 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 Apr 10 10:37:21 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:21 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8 1073741824" returned: 0 in 0.606s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:21 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8 Apr 10 10:37:21 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:21 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8" returned: 0 in 0.520s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.877s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729036564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a8c6ce-335f-4c1f-8a17-9665e2b4422c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:19Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Creating volume e6a8c6ce-335f-4c1f-8a17-9665e2b4422c {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:21 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Acquiring lock "cinder-c2ca5ec6-cc89-4a69-8f81-9177c55e357e-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f3c3a9-0d94-49fe-9281-743832f84455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78638bb2-61a3-4c4a-aaa2-e3f1846babad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:21 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c 1073741824 Apr 10 10:37:21 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Lock "cinder-c2ca5ec6-cc89-4a69-8f81-9177c55e357e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:21 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8 (f5952c06-619b-4f88-8bc7-5afdc91db8d8): created successfully Apr 10 10:37:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78638bb2-61a3-4c4a-aaa2-e3f1846babad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (17d2f424-f014-48e9-9905-297313bfa2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:22 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d587368c-e4db-416f-8384-f5cf5af3c330 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created volume successfully. Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Acquiring lock "cinder-quobyte-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Lock "cinder-quobyte-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[a767e93e-c369-458a-ae1b-933426417ce8]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:22 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e Apr 10 10:37:22 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:22 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2" returned: 0 in 1.238s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df_c6jfcz3bdevstack@QuobyteHD, size 112.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:37:22 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Converted 112.00 MB image at 90.37 MB/s Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:22 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 1G Apr 10 10:37:22 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:22 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c 1073741824" returned: 0 in 0.658s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:22 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c Apr 10 10:37:22 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:22 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" returned: 0 in 0.755s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:22 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e Apr 10 10:37:22 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:23 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 1G" returned: 0 in 0.529s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b1a71-b6ee-4396-938e-22f48b19375f]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:23 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 Apr 10 10:37:23 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:23 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c" returned: 0 in 0.687s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.996s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056608490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1852e512-9c0a-4049-82e6-dc3256340763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:19Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Creating volume 1852e512-9c0a-4049-82e6-dc3256340763 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:23 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5fd2a5-fe7b-48df-9dd8-ed03c2c070b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:23 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763 1073741824 Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c561a28-e1ee-4195-b3f9-a484a6f7e558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:23 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:23 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c (e6a8c6ce-335f-4c1f-8a17-9665e2b4422c): created successfully Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c561a28-e1ee-4195-b3f9-a484a6f7e558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (d538c81d-7f71-47c3-8f04-7727de50c1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c4f90ceb-27cb-4d97-a0ca-e6b8064990b3 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created volume successfully. Apr 10 10:37:23 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" returned: 0 in 0.674s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Lock "cinder-quobyte-c2ca5ec6-cc89-4a69-8f81-9177c55e357e" released by "delete_volume" :: held 1.464s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Created reservations ['99b980a0-0344-405e-96c6-2095eed2b6a2', '8ebfd54b-b0d9-4bf7-ab04-b3ba76221e0a', '3fd7ca2c-c963-4832-93fb-bd2d4c362d41', '51c0cde5-5e9d-4f32-9295-8c5323f808af'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:23 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:23 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:23 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2" returned: 0 in 0.641s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:23 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 Apr 10 10:37:23 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:24 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763 1073741824" returned: 0 in 0.714s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:24 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763 Apr 10 10:37:24 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:24 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.628s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Deleted volume successfully. Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9228c5a2-38c1-4fd4-a36b-0d1a215cdfda tempest-VolumesExtendTest-1557961593 None] Lock "cinder-c2ca5ec6-cc89-4a69-8f81-9177c55e357e-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:24 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2" returned: 1 in 0.739s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Downloaded image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df ((None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}])) to volume 2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 successfully. {{(pid=83037) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Temporary image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df for user cf2dcc01ff5a43a78a3fb76bd1d99da6 is deleted. {{(pid=83037) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.volume_utils [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Marking volume 2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 as bootable. {{(pid=83037) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Copying metadata from image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df to 2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2. {{(pid=83037) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Creating volume glance metadata for volume 2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 backed by image d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83037) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6ff5b4-21e2-4a39-8259-604477550f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2', 'volume_size': 1, 'image_id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4e2837c790a64b89a2b24e984470c50a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd3a5f9c3-5623-46fb-b9d6-8f2240fcc8df', 'created_at': datetime.datetime(2026, 4, 10, 8, 26, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 26, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d3a5f9c3-5623-46fb-b9d6-8f2240fcc8df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44563fcc-1acf-47ef-8839-657b05706112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:24 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Volume volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 (2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2): created successfully Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44563fcc-1acf-47ef-8839-657b05706112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (ce839aae-45bc-4822-9e8f-5d1f8981a240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-92f62785-cb50-49d4-b5ef-5fc41c282301 tempest-VolumesGetTest-31708936 None] Created volume successfully. Apr 10 10:37:24 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763" returned: 0 in 0.684s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.042s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1379659452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fbeb42-fc97-4623-8840-e3ae1fa59ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f12986cfa045029ab7b15504dca66b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:19Z,use_quota=True,user_id='2dfb67a8e96a418d9fc30be94f1e05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Creating volume 73fbeb42-fc97-4623-8840-e3ae1fa59ac1 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:24 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190ebd9b-6924-4b48-82b2-7e13724cf459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1852e512-9c0a-4049-82e6-dc3256340763', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c358fa-cffe-4ae9-ad4a-219eee718b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:24 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1 1073741824 Apr 10 10:37:24 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:24 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume volume-1852e512-9c0a-4049-82e6-dc3256340763 (1852e512-9c0a-4049-82e6-dc3256340763): created successfully Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c358fa-cffe-4ae9-ad4a-219eee718b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:24 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (a6af043b-ec9f-4d08-aa71-78d79a5d3c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-314e1810-9089-416a-b129-3e46eae3734f tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created volume successfully. Apr 10 10:37:25 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1 1073741824" returned: 0 in 0.838s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:25 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1 Apr 10 10:37:25 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (0fe02c3f-c511-4f72-bf88-d87937ac266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7c1530-47c4-49f1-8277-7094c23f6ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7c1530-47c4-49f1-8277-7094c23f6ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-157825891',display_name='tempest-VolumesGetTest-Volume-1104263864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0940afa9-c44f-4b9b-82c3-1c2f2af65a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:26Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4581647a-24fc-4620-aad4-e403686e9c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4581647a-24fc-4620-aad4-e403686e9c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d79b0fc-021e-4f05-b43d-83113b74286f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d79b0fc-021e-4f05-b43d-83113b74286f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0940afa9-c44f-4b9b-82c3-1c2f2af65a6a', 'volume_name': 'volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9518dd-4a6a-4171-a465-d09ede37adb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9518dd-4a6a-4171-a465-d09ede37adb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2131c8b1-cc12-4cf4-9400-2346eebe90b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:25 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Volume 0940afa9-c44f-4b9b-82c3-1c2f2af65a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a', 'volume_size': 1} Apr 10 10:37:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:26 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1" returned: 0 in 0.566s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.386s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-93510312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64300397-1433-438a-9857-9eac9c454334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcfa95313e14f6c8846686565bdf29d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:20Z,use_quota=True,user_id='18812190024a4315ae554408fb18e4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Creating volume 64300397-1433-438a-9857-9eac9c454334 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:26 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906bef7b-f835-4244-955e-35f2e2be1f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f01cf2-6e06-4217-8b46-a0bb19d41ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:26 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334 1073741824 Apr 10 10:37:26 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Volume volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1 (73fbeb42-fc97-4623-8840-e3ae1fa59ac1): created successfully Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f01cf2-6e06-4217-8b46-a0bb19d41ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Flow 'volume_create_manager' (7be7c478-e45a-4927-b303-b1915be30449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f75c1097-2341-407e-a7ab-95b059abbc45 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created volume successfully. Apr 10 10:37:26 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334 1073741824" returned: 0 in 0.669s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:26 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334 Apr 10 10:37:26 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Flow 'volume_create_manager' (d875873a-64b2-4d09-9317-91dc918658df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b343e807-e6c2-4614-8aaa-d92720be0f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b343e807-e6c2-4614-8aaa-d92720be0f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1774778175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be4628b-447f-4822-b5cb-436cf9dfb6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045970ca239947fda822a5f3aa058d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:27Z,use_quota=True,user_id='d55554b9338e421b8730a9cf5ea6ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500a828a-cb3f-44c4-bc78-250fb440cfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500a828a-cb3f-44c4-bc78-250fb440cfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4350d4c8-3e11-4fb1-bbe8-f2f06959c699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4350d4c8-3e11-4fb1-bbe8-f2f06959c699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be4628b-447f-4822-b5cb-436cf9dfb6a8', 'volume_name': 'volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f07a558-2fbb-4329-bc84-f254e0a1545e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f07a558-2fbb-4329-bc84-f254e0a1545e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a14c61-ba1b-4f4d-ae80-09306056aaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Volume 8be4628b-447f-4822-b5cb-436cf9dfb6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8', 'volume_size': 1} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-73fbeb42-fc97-4623-8840-e3ae1fa59ac1-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-73fbeb42-fc97-4623-8840-e3ae1fa59ac1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-quobyte-73fbeb42-fc97-4623-8840-e3ae1fa59ac1" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-73fbeb42-fc97-4623-8840-e3ae1fa59ac1" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf7cc7d-eebe-49a5-8003-e8c25dce3150]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:27 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1 Apr 10 10:37:27 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:27 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334" returned: 0 in 0.561s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.566s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-157825891',display_name='tempest-VolumesGetTest-Volume-1104263864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0940afa9-c44f-4b9b-82c3-1c2f2af65a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab4e0282e704af49c8ad03dfb058c1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:26Z,use_quota=True,user_id='cf2dcc01ff5a43a78a3fb76bd1d99da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Creating volume 0940afa9-c44f-4b9b-82c3-1c2f2af65a6a {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:27 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b65d72-4799-4182-84ad-e73ced7aae9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64300397-1433-438a-9857-9eac9c454334', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a 1073741824 Apr 10 10:37:27 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d04cf1-379b-4136-9685-9470f08ce8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Volume volume-64300397-1433-438a-9857-9eac9c454334 (64300397-1433-438a-9857-9eac9c454334): created successfully Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d04cf1-379b-4136-9685-9470f08ce8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Flow 'volume_create_manager' (2f45316a-0818-428e-8d90-6582ef5fab93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:27 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ac6a2566-ec2b-4b46-9fea-4ec5b6b4bd67 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Created volume successfully. Apr 10 10:37:27 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1" returned: 0 in 0.570s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:27 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1 Apr 10 10:37:27 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Acquiring lock "cinder-64300397-1433-438a-9857-9eac9c454334-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "cinder-64300397-1433-438a-9857-9eac9c454334-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:28 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a 1073741824" returned: 0 in 0.709s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Acquiring lock "cinder-quobyte-64300397-1433-438a-9857-9eac9c454334" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "cinder-quobyte-64300397-1433-438a-9857-9eac9c454334" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[102616b7-09d2-4125-98cd-3e9bf2d913f0]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:28 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a Apr 10 10:37:28 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334 Apr 10 10:37:28 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-73fbeb42-fc97-4623-8840-e3ae1fa59ac1" returned: 0 in 0.547s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-73fbeb42-fc97-4623-8840-e3ae1fa59ac1" released by "delete_volume" :: held 1.147s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created reservations ['8635f545-3a6d-4a99-87ce-6aa1035a71cc', 'eebf1dea-1790-46d7-bef8-9972cdd5616b', 'ad658f89-4ee5-477d-9f4b-83d63d9c4b61', '2b90c63e-2420-4812-9fbd-31a4cd9ce3e2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:28 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:28 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a" returned: 0 in 0.549s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.807s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1774778175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8be4628b-447f-4822-b5cb-436cf9dfb6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045970ca239947fda822a5f3aa058d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:27Z,use_quota=True,user_id='d55554b9338e421b8730a9cf5ea6ae76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Creating volume 8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:28 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:28 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334" returned: 0 in 0.607s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:28 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 1073741824 Apr 10 10:37:28 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2131c8b1-cc12-4cf4-9400-2346eebe90b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e640e0d7-43d7-48d1-9a08-e54471612775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:28 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334 Apr 10 10:37:28 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Volume volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a (0940afa9-c44f-4b9b-82c3-1c2f2af65a6a): created successfully Apr 10 10:37:28 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e640e0d7-43d7-48d1-9a08-e54471612775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Flow 'volume_create_manager' (0fe02c3f-c511-4f72-bf88-d87937ac266b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8311bc12-1a38-4f8e-b2f5-123fde9e4ace tempest-VolumesGetTest-31708936 None] Created volume successfully. Apr 10 10:37:29 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.630s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:29 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Deleted volume successfully. Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ffcb2533-9397-4ff3-b264-f5953db075af tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-73fbeb42-fc97-4623-8840-e3ae1fa59ac1-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Lock "cinder-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-quobyte-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7adf95-6474-4c25-b808-66b187c3a67f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-1852e512-9c0a-4049-82e6-dc3256340763-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-1852e512-9c0a-4049-82e6-dc3256340763-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:29 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a Apr 10 10:37:29 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:29 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-64300397-1433-438a-9857-9eac9c454334" returned: 0 in 0.665s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-quobyte-1852e512-9c0a-4049-82e6-dc3256340763" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "cinder-quobyte-64300397-1433-438a-9857-9eac9c454334" released by "delete_volume" :: held 1.317s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-1852e512-9c0a-4049-82e6-dc3256340763" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32c2404-1149-4024-8299-9666ed171b48]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:29 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 1073741824" returned: 0 in 0.774s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Created reservations ['db8fe7bf-e25f-4eaf-a2bf-9281b4b439a1', '1eeb5c4c-4fb7-439b-a573-31de924edb8e', 'ec41ff36-6fba-496a-87a9-6697a31be7ad', '44fb5351-b45b-4bd6-93f8-d6fe1f15be18'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:29 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763 Apr 10 10:37:29 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:29 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 Apr 10 10:37:29 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:29 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:29 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:30 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a" returned: 0 in 0.725s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:30 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a Apr 10 10:37:30 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:30 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.607s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:30 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Deleted volume successfully. Apr 10 10:37:30 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763" returned: 0 in 0.801s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8" returned: 0 in 0.753s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4868804c-efaa-400d-9dbd-eba7174779f2 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "cinder-64300397-1433-438a-9857-9eac9c454334-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a14c61-ba1b-4f4d-ae80-09306056aaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:30 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763 Apr 10 10:37:30 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a5b65e-31d7-4fd4-8380-54a764d395bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:30 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Volume volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 (8be4628b-447f-4822-b5cb-436cf9dfb6a8): created successfully Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a5b65e-31d7-4fd4-8380-54a764d395bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Flow 'volume_create_manager' (d875873a-64b2-4d09-9317-91dc918658df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-37d044b6-9801-4ace-8bad-50af8d3c96e1 tempest-VolumesSnapshotListTestJSON-333553066 None] Created volume successfully. Apr 10 10:37:30 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a" returned: 0 in 0.647s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a" released by "delete_volume" :: held 1.404s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Created reservations ['51a3e91a-7408-4b84-9741-3377561f2893', '67c86226-ace9-4d15-9584-ebef7be1c9bc', 'aea01f47-55b1-4212-af1b-ae53bbb3f730', 'b42bf64d-69bf-4400-b724-4f73f53a114d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Flow 'volume_create_manager' (c64fe7f0-dec1-4c82-8a16-ffc8b4fc0553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e502b9-7d45-4633-b65f-e92943ca5244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e502b9-7d45-4633-b65f-e92943ca5244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1181898678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0126627-8c53-4a56-a1fa-2c2c319d2232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcfa95313e14f6c8846686565bdf29d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:31Z,use_quota=True,user_id='18812190024a4315ae554408fb18e4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f53df2c-db42-4720-98f7-af6344b76c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f53df2c-db42-4720-98f7-af6344b76c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23c3d30-1ee6-480f-899b-e47530b425d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23c3d30-1ee6-480f-899b-e47530b425d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0126627-8c53-4a56-a1fa-2c2c319d2232', 'volume_name': 'volume-a0126627-8c53-4a56-a1fa-2c2c319d2232', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91b4f02-b1bc-4c78-b53b-13d23778c98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91b4f02-b1bc-4c78-b53b-13d23778c98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4805268c-6009-463f-91d3-1f731ca0abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:30 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Volume a0126627-8c53-4a56-a1fa-2c2c319d2232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0126627-8c53-4a56-a1fa-2c2c319d2232', 'volume_size': 1} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1181898678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0126627-8c53-4a56-a1fa-2c2c319d2232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcfa95313e14f6c8846686565bdf29d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:31Z,use_quota=True,user_id='18812190024a4315ae554408fb18e4bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Creating volume a0126627-8c53-4a56-a1fa-2c2c319d2232 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:30 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:30 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232 1073741824 Apr 10 10:37:30 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:31 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:31 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:31 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1852e512-9c0a-4049-82e6-dc3256340763" returned: 0 in 0.649s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-1852e512-9c0a-4049-82e6-dc3256340763" released by "delete_volume" :: held 1.477s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created reservations ['068cc771-1ec0-45e2-a35e-197312bda35e', 'ed9262ca-bc35-4846-81e6-b522fc13b28f', 'c59ca257-6643-4815-9592-f543545c2a8c', 'd8e0e2cc-a2d9-4829-9ba8-269818a64af6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:31 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:31 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Lock "cinder-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Acquiring lock "cinder-quobyte-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:31 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.675s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Deleted volume successfully. Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4b620db-f4a7-44ef-8177-8749cc7f1008 tempest-VolumesGetTest-31708936 None] Lock "cinder-0940afa9-c44f-4b9b-82c3-1c2f2af65a6a-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[235a2879-1389-4567-8666-775839259850]: (4, 'raw') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:31 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232 1073741824" returned: 0 in 0.882s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:31 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 Apr 10 10:37:31 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-quobyte-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c" acquired by "delete_volume" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1a6ae0-fd7a-4d28-b151-e4393be96f67]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:31 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:31 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232 Apr 10 10:37:31 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.773s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Deleted volume successfully. Apr 10 10:37:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-909b833e-fa7f-4526-a4a7-6420407080b2 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-1852e512-9c0a-4049-82e6-dc3256340763-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:32 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c Apr 10 10:37:32 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:32 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2" returned: 0 in 0.652s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:32 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232" returned: 0 in 0.499s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.937s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] Creating offline snapshot adfdd649-733a-4888-83d3-2ac758ec75fa of volume 8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4805268c-6009-463f-91d3-1f731ca0abc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0126627-8c53-4a56-a1fa-2c2c319d2232', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d63e694-0d9e-42e7-b7d7-ec937d17d502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[da425507-e33b-4c6b-b377-7253c6068daa]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:32 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 Apr 10 10:37:32 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:32 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Volume volume-a0126627-8c53-4a56-a1fa-2c2c319d2232 (a0126627-8c53-4a56-a1fa-2c2c319d2232): created successfully Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d63e694-0d9e-42e7-b7d7-ec937d17d502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Flow 'volume_create_manager' (c64fe7f0-dec1-4c82-8a16-ffc8b4fc0553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:32 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c" returned: 0 in 0.567s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4b798803-55b9-4d59-b973-755161ff1036 tempest-VolumeQuotasAdminTestJSON-1566791330 None] Created volume successfully. Apr 10 10:37:32 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c Apr 10 10:37:32 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:32 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 Apr 10 10:37:32 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:32 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2" returned: 1 in 0.591s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2' failed. Not Retrying. {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:33 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2 Apr 10 10:37:33 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:33 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c" returned: 0 in 0.558s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c" released by "delete_volume" :: held 1.169s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:33 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8" returned: 0 in 0.633s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:33 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa 1G Apr 10 10:37:33 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created reservations ['ad48bcf1-baed-4a0e-a30c-e75d80aabe1d', '22f42b62-8df6-41f2-b2d9-3a3f557b3472', '913a34c9-fa47-4f40-bf11-42e1c191543f', '022ff0ed-3112-4532-a3f3-4ed48503ee42'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:33 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:33 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:33 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6cefdaa7-292b-4d30-b786-80c81451d1d0 tempest-VolumeQuotasAdminTestJSON-1259075210 None] Transfer volume completed successfully. Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2" returned: 0 in 0.606s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Lock "cinder-quobyte-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2" released by "delete_volume" :: held 1.906s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Created reservations ['c980b8c8-72f2-4d27-81fb-ddea9a56c907', '01949fba-bc8b-4700-a753-7f7eaf0121bd', '5bef7749-ea75-4f1a-877d-800ac271aed0', 'bf13a9af-567f-4bde-8028-997f73bbe2a1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:33 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.528s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Deleted volume successfully. Apr 10 10:37:33 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:33 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:33 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa 1G" returned: 0 in 0.704s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-554a9807-8ac2-435e-ba01-7f47a52abdba tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-e6a8c6ce-335f-4c1f-8a17-9665e2b4422c-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:33 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa Apr 10 10:37:33 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-f5952c06-619b-4f88-8bc7-5afdc91db8d8-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-f5952c06-619b-4f88-8bc7-5afdc91db8d8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-quobyte-f5952c06-619b-4f88-8bc7-5afdc91db8d8" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-f5952c06-619b-4f88-8bc7-5afdc91db8d8" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73f51b2-6721-42ff-a1b0-1f92e5e1a581]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:34 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8 Apr 10 10:37:34 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:34 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:34 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa" returned: 0 in 0.588s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:34 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa is being set with open permissions: ugo+rw Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:34 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Deleted volume successfully. Apr 10 10:37:34 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa Apr 10 10:37:34 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c2241438-d249-49b5-a257-1c7838c4c47a tempest-VolumesGetTest-31708936 None] Lock "cinder-2308cb9b-ebc9-4ecf-8b5c-83dbc1e762f2-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Acquiring lock "cinder-a0126627-8c53-4a56-a1fa-2c2c319d2232-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Lock "cinder-a0126627-8c53-4a56-a1fa-2c2c319d2232-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Acquiring lock "cinder-quobyte-a0126627-8c53-4a56-a1fa-2c2c319d2232" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Lock "cinder-quobyte-a0126627-8c53-4a56-a1fa-2c2c319d2232" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f1277-aef2-4542-ba22-87376297d006]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:34 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232 Apr 10 10:37:34 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:34 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8" returned: 0 in 0.838s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:34 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8 Apr 10 10:37:34 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:35 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa" returned: 0 in 0.685s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:35 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.info Apr 10 10:37:35 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:35 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232" returned: 0 in 0.652s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:35 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232 Apr 10 10:37:35 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:35 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5952c06-619b-4f88-8bc7-5afdc91db8d8" returned: 0 in 0.544s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-f5952c06-619b-4f88-8bc7-5afdc91db8d8" released by "delete_volume" :: held 1.414s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created reservations ['00952364-168b-49ff-bd1e-369fe7abd356', 'e1377856-042e-481f-901f-f1e2831e2a05', 'e83ac458-ed3d-41e2-bec1-f0264bcb62d5', '13edaa9c-1df3-4195-9838-d708fa3a6d15'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:35 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:35 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:35 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.info" returned: 0 in 0.584s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:35 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.info is being set with open permissions: ugo+rw Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:35 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.info Apr 10 10:37:35 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:35 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0126627-8c53-4a56-a1fa-2c2c319d2232" returned: 0 in 0.633s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Lock "cinder-quobyte-a0126627-8c53-4a56-a1fa-2c2c319d2232" released by "delete_volume" :: held 1.319s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Created reservations ['e5d1fb3a-83f5-481e-8448-775d6316e1f3', '3b4db97d-816c-4971-a64b-f371438296e5', '69ad6fd0-8aa4-4487-95e1-4f54a1a95d10', 'af98cbd7-bda5-4ff2-babc-b1e13a9a0f49'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:36 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:36 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:36 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Deleted volume successfully. Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7a51b627-a2d6-40be-89e6-3620e25884b7 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-f5952c06-619b-4f88-8bc7-5afdc91db8d8-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-c0637444-534b-4993-b59f-5abf68123e0b-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-c0637444-534b-4993-b59f-5abf68123e0b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:36 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.info" returned: 0 in 0.684s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-quobyte-c0637444-534b-4993-b59f-5abf68123e0b" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.980s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-c0637444-534b-4993-b59f-5abf68123e0b" acquired by "delete_volume" :: waited 0.031s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-628cdc21-b176-4a7e-9e54-9ad6d821f499 tempest-VolumesSnapshotListTestJSON-333553066 None] Create snapshot completed successfully Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1502904-04f8-4b8b-908e-43b51b2c78b5]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:36 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b Apr 10 10:37:36 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Flow 'volume_create_manager' (38455973-d347-4251-8141-1c00235fa552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77afae6-4dc1-4a64-b3b9-20341bbc5f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77afae6-4dc1-4a64-b3b9-20341bbc5f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1601611903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffefd4a-63b1-48dd-88d0-66f91c32328b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dae66a32df3d4d7fbc0957095cedaf3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:37Z,use_quota=True,user_id='d3c8d0fb86464e868eae9bbe073e9448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e379a99-6e83-4ff0-af4d-11fd46c2e10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e379a99-6e83-4ff0-af4d-11fd46c2e10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e686d31c-846c-44f7-95df-a73f3be0383d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e686d31c-846c-44f7-95df-a73f3be0383d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ffefd4a-63b1-48dd-88d0-66f91c32328b', 'volume_name': 'volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddcb121-b113-42d1-b964-f83b5b94ab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddcb121-b113-42d1-b964-f83b5b94ab35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8f0b95-0f9d-43a5-ab9d-6a948741fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:36 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Volume 9ffefd4a-63b1-48dd-88d0-66f91c32328b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b', 'volume_size': 1} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1601611903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffefd4a-63b1-48dd-88d0-66f91c32328b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dae66a32df3d4d7fbc0957095cedaf3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:37Z,use_quota=True,user_id='d3c8d0fb86464e868eae9bbe073e9448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Creating volume 9ffefd4a-63b1-48dd-88d0-66f91c32328b {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:36 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:36 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b 1073741824 Apr 10 10:37:36 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:36 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.622s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Deleted volume successfully. Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ee516378-91c5-4894-b582-f23293c06faf tempest-VolumeQuotasAdminTestJSON-1550394461 None] Lock "cinder-a0126627-8c53-4a56-a1fa-2c2c319d2232-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:37 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b" returned: 0 in 0.626s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:37 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b Apr 10 10:37:37 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:37 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b 1073741824" returned: 0 in 0.651s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:37 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b Apr 10 10:37:37 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:37 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c0637444-534b-4993-b59f-5abf68123e0b" returned: 0 in 0.627s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-c0637444-534b-4993-b59f-5abf68123e0b" released by "delete_volume" :: held 1.290s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created reservations ['b1cd5c2c-9cb0-4bb0-a8fb-d06030ad5cc0', '73583a25-90f6-45ab-9ec6-e2d091eb22c9', 'd926a780-70eb-4710-9816-686ccb1da8c4', '0f652ba1-9e96-405d-9393-ea09907c829a'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:37 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:37 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:38 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b" returned: 0 in 0.609s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.179s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8f0b95-0f9d-43a5-ab9d-6a948741fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f1ddd0-048e-44cd-8585-e3938170b984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] Creating offline snapshot 32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e of volume 8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:38 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Volume volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b (9ffefd4a-63b1-48dd-88d0-66f91c32328b): created successfully Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f1ddd0-048e-44cd-8585-e3938170b984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Flow 'volume_create_manager' (38455973-d347-4251-8141-1c00235fa552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb6a62b-e65e-4b8d-ae8e-e1f09c43fa9f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bae6ac11-58f6-4a1d-af4a-cbac9aac977e tempest-VolumesListTestJSON-894847013 None] Created volume successfully. Apr 10 10:37:38 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa Apr 10 10:37:38 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:38 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.597s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Deleted volume successfully. Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b14d9d99-1723-4660-8aa9-bb40b2758ae6 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-c0637444-534b-4993-b59f-5abf68123e0b-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-b3dd35f6-56fb-45c7-803d-4a7ce141eb11-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-b3dd35f6-56fb-45c7-803d-4a7ce141eb11-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "cinder-quobyte-b3dd35f6-56fb-45c7-803d-4a7ce141eb11" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-b3dd35f6-56fb-45c7-803d-4a7ce141eb11" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cf04f3-91a9-4767-8099-ef2a5b022bd2]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:38 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11 Apr 10 10:37:38 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:38 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa" returned: 0 in 0.806s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:38 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e 1G Apr 10 10:37:38 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Flow 'volume_create_manager' (edb3b761-55cb-4645-979f-eac5c98910ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea621249-9613-45e8-9b7e-f52362950883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea621249-9613-45e8-9b7e-f52362950883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-731667268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d72e0aaa-4b11-4881-a3ff-586ee3fe39ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dae66a32df3d4d7fbc0957095cedaf3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:39Z,use_quota=True,user_id='d3c8d0fb86464e868eae9bbe073e9448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa9c4b4-b969-44cc-930c-ee5693e2d9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa9c4b4-b969-44cc-930c-ee5693e2d9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca630c3d-9c43-4992-9f98-a888bc915caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca630c3d-9c43-4992-9f98-a888bc915caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd72e0aaa-4b11-4881-a3ff-586ee3fe39ab', 'volume_name': 'volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c01a2d-eaa3-4314-9c4b-b3263a041270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c01a2d-eaa3-4314-9c4b-b3263a041270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cde1470-2d9e-4f2c-92e2-ea2c8f78d6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Volume d72e0aaa-4b11-4881-a3ff-586ee3fe39ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab', 'volume_size': 1} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:39 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11" returned: 0 in 0.700s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:39 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11 Apr 10 10:37:39 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:39 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e 1G" returned: 0 in 0.681s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:39 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e Apr 10 10:37:39 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:39 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b3dd35f6-56fb-45c7-803d-4a7ce141eb11" returned: 0 in 0.593s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-quobyte-b3dd35f6-56fb-45c7-803d-4a7ce141eb11" released by "delete_volume" :: held 1.332s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:39 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Created reservations ['7f419b7b-3e9f-4491-85bb-fd45c9f924b2', 'bc2f4614-1ddd-4d0b-9332-1cf1b8fc42b0', '686d7c78-b05d-492d-8d62-080698a9b560', 'c8f37bae-71da-465d-a3ab-2ad441548010'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:40 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:40 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e" returned: 0 in 0.660s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:40 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e is being set with open permissions: ugo+rw Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e Apr 10 10:37:40 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:40 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.622s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:40 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Deleted volume successfully. Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9983293c-759c-4b83-9154-4cf692bce1c4 tempest-CreateVolumesFromSourceVolumeTest-364777586 None] Lock "cinder-b3dd35f6-56fb-45c7-803d-4a7ce141eb11-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:40 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e" returned: 0 in 0.644s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.915s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.696s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-731667268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d72e0aaa-4b11-4881-a3ff-586ee3fe39ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dae66a32df3d4d7fbc0957095cedaf3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:39Z,use_quota=True,user_id='d3c8d0fb86464e868eae9bbe073e9448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Creating volume d72e0aaa-4b11-4881-a3ff-586ee3fe39ab {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:40 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab 1073741824 Apr 10 10:37:40 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:41 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d679ad06-a6f6-4cdb-9ab0-ae56835ae957 tempest-VolumesSnapshotListTestJSON-333553066 None] Create snapshot completed successfully Apr 10 10:37:41 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab 1073741824" returned: 0 in 0.794s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:41 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab Apr 10 10:37:41 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:42 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab" returned: 0 in 0.735s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.291s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cde1470-2d9e-4f2c-92e2-ea2c8f78d6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debf9fed-ee57-48d3-9cf0-479d84b70a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] Creating offline snapshot bc698636-f9a5-43d2-b5b6-94e5083620ab of volume 8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:42 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Volume volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab (d72e0aaa-4b11-4881-a3ff-586ee3fe39ab): created successfully Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debf9fed-ee57-48d3-9cf0-479d84b70a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Flow 'volume_create_manager' (edb3b761-55cb-4645-979f-eac5c98910ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[296c6e79-4acf-4d84-8a0b-5c74a0407596]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:42 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5a6edd7f-a238-494e-9715-4b0ee836455e tempest-VolumesListTestJSON-894847013 None] Created volume successfully. Apr 10 10:37:42 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e Apr 10 10:37:42 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:43 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e" returned: 0 in 0.697s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:43 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab 1G Apr 10 10:37:43 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Flow 'volume_create_manager' (7d9c0585-aa27-46d8-aeb7-cfb9416e5f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f18952-44a4-4eb6-bf3c-27c5a287022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f18952-44a4-4eb6-bf3c-27c5a287022f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1733942042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0dc268-b1c5-42e8-88e0-8b16bcee98ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91de0a6ba654e409ca3a9c7d59699ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:43Z,use_quota=True,user_id='6f5751d05f9749d1912e9f1cd3e0075f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e063fea-7e9a-4595-aa42-6eaded2e2548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e063fea-7e9a-4595-aa42-6eaded2e2548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25da721-2c2b-40d3-bbd9-44ed2f95c3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25da721-2c2b-40d3-bbd9-44ed2f95c3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e0dc268-b1c5-42e8-88e0-8b16bcee98ff', 'volume_name': 'volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a464974-e04a-4739-9784-27c47ad7a901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a464974-e04a-4739-9784-27c47ad7a901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb23352-951a-4b01-8469-0ce2c5f7f5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Volume 0e0dc268-b1c5-42e8-88e0-8b16bcee98ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff', 'volume_size': 1} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Flow 'volume_create_manager' (82372466-2684-4d1f-9d48-1e7fb1bd9075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4668210-591c-49e5-a735-6ef44c64bfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4668210-591c-49e5-a735-6ef44c64bfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1610804305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71875456-1aa9-43c7-b06e-e7509891ac24,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dae66a32df3d4d7fbc0957095cedaf3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:44Z,use_quota=True,user_id='d3c8d0fb86464e868eae9bbe073e9448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94ea46f-44a0-423c-86b7-29e054e0c5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94ea46f-44a0-423c-86b7-29e054e0c5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33333cd8-3e3f-456b-8faf-c7e6468fbea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33333cd8-3e3f-456b-8faf-c7e6468fbea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71875456-1aa9-43c7-b06e-e7509891ac24', 'volume_name': 'volume-71875456-1aa9-43c7-b06e-e7509891ac24', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e00c9e-5f43-4f69-bbe2-47691bce0f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e00c9e-5f43-4f69-bbe2-47691bce0f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89765d6-c284-4f70-8f06-d4655f4c4947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Volume 71875456-1aa9-43c7-b06e-e7509891ac24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71875456-1aa9-43c7-b06e-e7509891ac24', 'volume_size': 1} Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:44 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab 1G" returned: 0 in 0.821s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:44 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab Apr 10 10:37:44 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:44 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab" returned: 0 in 0.595s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:44 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab is being set with open permissions: ugo+rw Apr 10 10:37:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:44 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab Apr 10 10:37:44 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:45 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab" returned: 0 in 0.608s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.732s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1733942042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e0dc268-b1c5-42e8-88e0-8b16bcee98ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91de0a6ba654e409ca3a9c7d59699ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:43Z,use_quota=True,user_id='6f5751d05f9749d1912e9f1cd3e0075f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Creating volume 0e0dc268-b1c5-42e8-88e0-8b16bcee98ff {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:45 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4efadbdb-419b-4390-b911-316f9884a3d0 tempest-VolumesSnapshotListTestJSON-333553066 None] Create snapshot completed successfully Apr 10 10:37:45 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff 1073741824 Apr 10 10:37:45 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:46 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff 1073741824" returned: 0 in 0.736s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:46 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff Apr 10 10:37:46 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:46 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" returned: 0 in 0.607s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.726s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1610804305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71875456-1aa9-43c7-b06e-e7509891ac24,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dae66a32df3d4d7fbc0957095cedaf3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:44Z,use_quota=True,user_id='d3c8d0fb86464e868eae9bbe073e9448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Creating volume 71875456-1aa9-43c7-b06e-e7509891ac24 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:46 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb23352-951a-4b01-8469-0ce2c5f7f5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bafce9-8251-48e6-b8ad-366561c58957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:46 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24 1073741824 Apr 10 10:37:46 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Volume volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff (0e0dc268-b1c5-42e8-88e0-8b16bcee98ff): created successfully Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bafce9-8251-48e6-b8ad-366561c58957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Flow 'volume_create_manager' (7d9c0585-aa27-46d8-aeb7-cfb9416e5f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-39bfab49-7dd6-47be-a862-057bc0090c8a tempest-VolumeDependencyTests-80356891 None] Created volume successfully. Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "cinder-bc698636-f9a5-43d2-b5b6-94e5083620ab-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-bc698636-f9a5-43d2-b5b6-94e5083620ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "cinder-quobyte-bc698636-f9a5-43d2-b5b6-94e5083620ab" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-bc698636-f9a5-43d2-b5b6-94e5083620ab" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Deleting offline snapshot bc698636-f9a5-43d2-b5b6-94e5083620ab of volume 8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] snapshot_file for this snap is: volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[494a22c6-f1df-44bd-a86a-9e22696d8817]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:47 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab Apr 10 10:37:47 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:47 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24 1073741824" returned: 0 in 0.755s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:47 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24 Apr 10 10:37:47 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:47 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab" returned: 0 in 0.734s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ff1bb2-9376-44ba-970f-c6dfce4d3cd1]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:48 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e Apr 10 10:37:48 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:48 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24" returned: 0 in 0.616s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.171s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] Creating offline snapshot 152c9fd5-ae68-4b09-926d-879136289b0a of volume 0e0dc268-b1c5-42e8-88e0-8b16bcee98ff {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89765d6-c284-4f70-8f06-d4655f4c4947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71875456-1aa9-43c7-b06e-e7509891ac24', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82f39a3-c7d0-44f2-b1d6-efa2b2f16d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff64923-7d4f-440e-9de2-5b704ef188b1]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:48 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Volume volume-71875456-1aa9-43c7-b06e-e7509891ac24 (71875456-1aa9-43c7-b06e-e7509891ac24): created successfully Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c82f39a3-c7d0-44f2-b1d6-efa2b2f16d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Flow 'volume_create_manager' (82372466-2684-4d1f-9d48-1e7fb1bd9075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-db426dee-221d-477f-af02-b1ca6f601b77 tempest-VolumesListTestJSON-894847013 None] Created volume successfully. Apr 10 10:37:48 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff Apr 10 10:37:48 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:48 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e" returned: 0 in 0.639s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:48 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab Apr 10 10:37:48 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:48 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" returned: 0 in 0.640s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:48 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a 1G Apr 10 10:37:48 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:49 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab" returned: 0 in 0.735s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:49 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab Apr 10 10:37:49 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:49 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a 1G" returned: 0 in 0.724s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:49 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a Apr 10 10:37:49 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:50 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.bc698636-f9a5-43d2-b5b6-94e5083620ab" returned: 0 in 0.775s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-bc698636-f9a5-43d2-b5b6-94e5083620ab" released by "_delete_snapshot" :: held 2.975s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" released by "delete_snapshot" :: held 2.992s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:50 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Created reservations ['8afc327a-8d3b-4f2f-938a-6ea2048e2a77', '3aecdabb-9179-45da-9647-80ac1689ae0b', '0e127059-3e9a-4606-b169-2ec13390a964', 'd4e24557-cbca-45b5-aff1-fe97e513f664'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:50 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a" returned: 0 in 0.653s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:50 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a is being set with open permissions: ugo+rw Apr 10 10:37:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:50 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a Apr 10 10:37:50 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Delete snapshot completed successfully. Apr 10 10:37:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-07f3f09a-b2d2-48b0-984b-56142a03a5b2 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-bc698636-f9a5-43d2-b5b6-94e5083620ab-delete_snapshot" released by "delete_snapshot" :: held 3.204s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:50 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a" returned: 0 in 0.662s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:50 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.info Apr 10 10:37:50 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "cinder-32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "cinder-quobyte-32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Deleting offline snapshot 32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e of volume 8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] snapshot_file for this snap is: volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73aee6-bd2b-4938-ae35-63a5371a10f9]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:51 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e Apr 10 10:37:51 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:51 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.info" returned: 0 in 0.685s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:51 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.info is being set with open permissions: ugo+rw Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:51 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.info Apr 10 10:37:51 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Acquiring lock "cinder-71875456-1aa9-43c7-b06e-e7509891ac24-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Lock "cinder-71875456-1aa9-43c7-b06e-e7509891ac24-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Acquiring lock "cinder-quobyte-71875456-1aa9-43c7-b06e-e7509891ac24" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Lock "cinder-quobyte-71875456-1aa9-43c7-b06e-e7509891ac24" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ffe6cc-25c3-4bf0-8e6e-f3a8ad5bcdda]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:52 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24 Apr 10 10:37:52 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:52 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e" returned: 0 in 0.757s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:52 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf75b4-6e15-426b-91cd-5724c57bad33]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:52 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.info" returned: 0 in 0.661s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.108s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-19f853fe-b030-43da-aa20-49d2e0c4e7ef tempest-VolumeDependencyTests-80356891 None] Create snapshot completed successfully Apr 10 10:37:52 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa Apr 10 10:37:52 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:52 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24" returned: 0 in 0.705s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:52 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24 Apr 10 10:37:52 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:52 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa" returned: 0 in 0.695s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:52 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e Apr 10 10:37:52 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:53 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-71875456-1aa9-43c7-b06e-e7509891ac24" returned: 0 in 0.533s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Lock "cinder-quobyte-71875456-1aa9-43c7-b06e-e7509891ac24" released by "delete_volume" :: held 1.275s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Created reservations ['f5697f32-db56-4a7e-a0f2-a8a041044332', '0229535d-b36f-479f-a031-47a1baa4df1d', '59b5d382-d3d9-408a-9d7d-d9d4998cf636', 'c7a0fc41-ca7f-47b7-b72f-0993f942bc49'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:53 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:53 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Flow 'volume_create_manager' (46cdaa62-1f93-4282-8eff-e6dcc6cf74ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:53 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3479b9-463a-4c67-8d95-e201f71dc220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e" returned: 0 in 0.808s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:53 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e Apr 10 10:37:53 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3479b9-463a-4c67-8d95-e201f71dc220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1444082479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8841b6-1832-476d-b1db-61a088492334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91de0a6ba654e409ca3a9c7d59699ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=152c9fd5-ae68-4b09-926d-879136289b0a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:54Z,use_quota=True,user_id='6f5751d05f9749d1912e9f1cd3e0075f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464a89b8-35c0-4b63-b08a-57188b0e48d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464a89b8-35c0-4b63-b08a-57188b0e48d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b54d93-5cd2-482c-9a40-e0c17fe30991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b54d93-5cd2-482c-9a40-e0c17fe30991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa8841b6-1832-476d-b1db-61a088492334', 'volume_name': 'volume-aa8841b6-1832-476d-b1db-61a088492334', 'volume_size': 1, 'snapshot_id': '152c9fd5-ae68-4b09-926d-879136289b0a'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eecd5d5-47f2-47b7-9a50-26845671879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eecd5d5-47f2-47b7-9a50-26845671879f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972d45cf-0463-4624-bab5-330a99c5a30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:53 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Volume aa8841b6-1832-476d-b1db-61a088492334: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa8841b6-1832-476d-b1db-61a088492334', 'volume_size': 1, 'snapshot_id': '152c9fd5-ae68-4b09-926d-879136289b0a'} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-quobyte-152c9fd5-ae68-4b09-926d-879136289b0a-aa8841b6-1832-476d-b1db-61a088492334" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-152c9fd5-ae68-4b09-926d-879136289b0a-aa8841b6-1832-476d-b1db-61a088492334" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Creating volume aa8841b6-1832-476d-b1db-61a088492334 from snapshot 152c9fd5-ae68-4b09-926d-879136289b0a {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-quobyte-aa8841b6-1832-476d-b1db-61a088492334" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-aa8841b6-1832-476d-b1db-61a088492334" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] snapshot: 152c9fd5-ae68-4b09-926d-879136289b0a, volume: aa8841b6-1832-476d-b1db-61a088492334, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f041ba-dd3b-4d86-95a0-3a82cb287820]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:54 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.646s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Deleted volume successfully. Apr 10 10:37:54 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a Apr 10 10:37:54 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4dab8ca9-7cd1-4925-a920-cacc8b0ea0cd tempest-VolumesListTestJSON-894847013 None] Lock "cinder-71875456-1aa9-43c7-b06e-e7509891ac24-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Acquiring lock "cinder-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Lock "cinder-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:54 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Acquiring lock "cinder-quobyte-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e" returned: 0 in 0.552s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e" released by "_delete_snapshot" :: held 2.905s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Lock "cinder-quobyte-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab" acquired by "delete_volume" :: waited 0.047s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" released by "delete_snapshot" :: held 2.939s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ac59b3-dc17-4ec4-9ad1-c24d7c457371]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Created reservations ['ddf2a157-2094-4a3f-bdc6-4f1a4707a999', 'ec863811-e2ce-4eda-99b3-ccd1020facc0', '55c04105-fc5b-4b88-94a7-c1463bc22777', 'cf2bf94e-5683-4d52-a38b-eff56b1afbbc'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:54 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab Apr 10 10:37:54 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Delete snapshot completed successfully. Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-d53edf23-53ec-409f-9d36-8c3028260551 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-32aa5bbf-2b21-4ba1-95c3-8c1cf9b21f6e-delete_snapshot" released by "delete_snapshot" :: held 3.093s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "cinder-adfdd649-733a-4888-83d3-2ac758ec75fa-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-adfdd649-733a-4888-83d3-2ac758ec75fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "cinder-quobyte-adfdd649-733a-4888-83d3-2ac758ec75fa" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-adfdd649-733a-4888-83d3-2ac758ec75fa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Deleting offline snapshot adfdd649-733a-4888-83d3-2ac758ec75fa of volume 8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] snapshot_file for this snap is: volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc46c7a-336a-43a7-a98e-ba9975c0643b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:54 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa Apr 10 10:37:54 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:54 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a" returned: 0 in 0.863s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c91702-48cb-4e30-8141-152ffb0c79d0]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:54 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff Apr 10 10:37:54 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:55 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab" returned: 0 in 0.737s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:55 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab Apr 10 10:37:55 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:55 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa" returned: 0 in 0.771s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0ecf67-0bf6-48ba-9f5a-763e47aaea55]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:55 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 Apr 10 10:37:55 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:55 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" returned: 0 in 0.731s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:55 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334 Apr 10 10:37:55 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:55 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab" returned: 0 in 0.573s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Lock "cinder-quobyte-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab" released by "delete_volume" :: held 1.348s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:INSERT=68,cinder:UPDATE=297,cinder:SELECT=198,cinder:DELETE=23 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=191,cinder:INSERT=71,cinder:UPDATE=240,cinder:DELETE=23 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Created reservations ['a8cb1688-ad61-4ebd-92cc-0752160fa9ec', '7e0d0fb9-cc76-44f1-a35f-f04dc20848c8', 'c7c6686f-322a-4466-9a4a-cc21ffe8f9c3', 'dc68e13d-f945-40b6-94cf-36ee73950f5f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:55 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:55 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:56 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8" returned: 0 in 0.702s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:56 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa Apr 10 10:37:56 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:56 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.862s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:56 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:56 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Deleted volume successfully. Apr 10 10:37:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-08035ce4-e07f-4a31-af87-9769b9fef9f7 tempest-VolumesListTestJSON-894847013 None] Lock "cinder-d72e0aaa-4b11-4881-a3ff-586ee3fe39ab-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Acquiring lock "cinder-9ffefd4a-63b1-48dd-88d0-66f91c32328b-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Lock "cinder-9ffefd4a-63b1-48dd-88d0-66f91c32328b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Acquiring lock "cinder-quobyte-9ffefd4a-63b1-48dd-88d0-66f91c32328b" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Lock "cinder-quobyte-9ffefd4a-63b1-48dd-88d0-66f91c32328b" acquired by "delete_volume" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad6ca97-d431-491c-bda6-55f1703b8d9b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:57 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b Apr 10 10:37:57 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:57 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:37:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:57 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:57 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:58 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa" returned: 0 in 1.959s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:58 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa Apr 10 10:37:58 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:59 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:59 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334" returned: 0 in 3.429s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 1.301s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810b136-d620-444c-abe9-84b1c2e36cf0]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:59 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b" returned: 0 in 2.044s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:59 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b Apr 10 10:37:59 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:59 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff Apr 10 10:37:59 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:59 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8.adfdd649-733a-4888-83d3-2ac758ec75fa" returned: 0 in 1.145s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-adfdd649-733a-4888-83d3-2ac758ec75fa" released by "_delete_snapshot" :: held 4.667s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" released by "delete_snapshot" :: held 4.692s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Created reservations ['b9888c31-0037-41a6-b429-87ec416971c2', '21b134c5-00f9-49a9-8277-0b7cb443ceb3', 'd3c6dd79-380e-42e8-805f-3729c6586c6c', 'e7cc17cd-2562-4bce-bcbc-f272b1790f4e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Delete snapshot completed successfully. Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5e1049ea-c402-4e6a-b238-ce81d22c4738 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-adfdd649-733a-4888-83d3-2ac758ec75fa-delete_snapshot" released by "delete_snapshot" :: held 4.858s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:59 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-9ffefd4a-63b1-48dd-88d0-66f91c32328b" returned: 0 in 0.676s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Lock "cinder-quobyte-9ffefd4a-63b1-48dd-88d0-66f91c32328b" released by "delete_volume" :: held 2.760s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Created reservations ['9b224504-16eb-4438-8e21-51f032ba8be6', 'ab125083-f755-486e-9fbd-4be75021a0e8', 'ecff833d-096b-4627-9861-fdc0f43d17f4', '4b0a5a90-b37e-45a0-8d01-4ffcea397faa'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:59 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" returned: 0 in 0.812s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff, size 1024.00 MB, duration 3.43 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:37:59 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Converted 1024.00 MB image at 298.55 MB/s Apr 10 10:37:59 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334 is being set with open permissions: ugo+rw Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:59 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334 Apr 10 10:37:59 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:59 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:37:59 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "cinder-8be4628b-447f-4822-b5cb-436cf9dfb6a8-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-8be4628b-447f-4822-b5cb-436cf9dfb6a8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[88def845-69ad-439c-8b63-dd960eceef33]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:00 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 Apr 10 10:38:00 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:00 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334" returned: 0 in 0.657s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-aa8841b6-1832-476d-b1db-61a088492334" released by "_copy_volume_from_snapshot" :: held 6.636s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-152c9fd5-ae68-4b09-926d-879136289b0a-aa8841b6-1832-476d-b1db-61a088492334" released by "_create_volume_from_snapshot" :: held 6.666s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.681s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:00 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Deleted volume successfully. Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972d45cf-0463-4624-bab5-330a99c5a30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8841b6-1832-476d-b1db-61a088492334', 'volume_size': 1, 'snapshot_id': '152c9fd5-ae68-4b09-926d-879136289b0a'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce4b5c2-b716-4c5b-95d5-22b0fdb5085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Volume volume-aa8841b6-1832-476d-b1db-61a088492334 (aa8841b6-1832-476d-b1db-61a088492334): created successfully Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce4b5c2-b716-4c5b-95d5-22b0fdb5085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Flow 'volume_create_manager' (46cdaa62-1f93-4282-8eff-e6dcc6cf74ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a875bed9-e1b4-4f79-b62b-2d53e3155c3b tempest-VolumesListTestJSON-894847013 None] Lock "cinder-9ffefd4a-63b1-48dd-88d0-66f91c32328b-delete_volume" released by "delete_volume" :: held 3.702s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5b1d427f-a1c1-42fe-83cb-c30147829ac2 tempest-VolumeDependencyTests-80356891 None] Created volume successfully. Apr 10 10:38:00 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8" returned: 0 in 0.730s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:00 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8 Apr 10 10:38:00 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:01 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8be4628b-447f-4822-b5cb-436cf9dfb6a8" returned: 0 in 0.612s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-quobyte-8be4628b-447f-4822-b5cb-436cf9dfb6a8" released by "delete_volume" :: held 1.392s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Created reservations ['8af0c874-db56-49ef-bd40-125b0579503a', '44bde8ce-63a6-4e7b-acc8-eb162716b78a', '6adec849-714d-4b81-950f-ec7932f8ea64', '0c65391a-df14-4931-91c7-b61238e46b58'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:01 devstack sudo[89161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:01 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-152c9fd5-ae68-4b09-926d-879136289b0a-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-152c9fd5-ae68-4b09-926d-879136289b0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-quobyte-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-quobyte-152c9fd5-ae68-4b09-926d-879136289b0a" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-152c9fd5-ae68-4b09-926d-879136289b0a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Deleting offline snapshot 152c9fd5-ae68-4b09-926d-879136289b0a of volume 0e0dc268-b1c5-42e8-88e0-8b16bcee98ff {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] snapshot_file for this snap is: volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[24df21cf-db38-4b40-b03c-c36a77106a6f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:01 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a Apr 10 10:38:01 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:02 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.704s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:02 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:02 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Deleted volume successfully. Apr 10 10:38:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14957d68-99a4-4e31-a07d-c4b5c4c5ebd6 tempest-VolumesSnapshotListTestJSON-333553066 None] Lock "cinder-8be4628b-447f-4822-b5cb-436cf9dfb6a8-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:02 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a" returned: 0 in 0.779s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae8ae13-d96a-433e-98bf-19750e87366d]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:02 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff Apr 10 10:38:02 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Flow 'volume_create_manager' (7e6db652-ada5-46df-b8e9-7fcbd6292cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5b09c5-f355-4ba1-b9e7-11caf6c4cf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5b09c5-f355-4ba1-b9e7-11caf6c4cf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-105769153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796b3599-30d1-42b4-a832-9c463ea589b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7621dc8310a74b008be7023d510db054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:03Z,use_quota=True,user_id='20998a99150d40e48a621efaf0372e0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94121b75-b87e-47a9-85ac-1c770f7eb0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94121b75-b87e-47a9-85ac-1c770f7eb0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1837cef-281b-400a-9c37-d020a21ede31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1837cef-281b-400a-9c37-d020a21ede31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '796b3599-30d1-42b4-a832-9c463ea589b9', 'volume_name': 'volume-796b3599-30d1-42b4-a832-9c463ea589b9', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36c0343-01bc-454b-8388-1cfbaf535e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36c0343-01bc-454b-8388-1cfbaf535e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bbe9ba-a811-41fe-bfdf-8cfaa63b2263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Volume 796b3599-30d1-42b4-a832-9c463ea589b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-796b3599-30d1-42b4-a832-9c463ea589b9', 'volume_size': 1} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-105769153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796b3599-30d1-42b4-a832-9c463ea589b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7621dc8310a74b008be7023d510db054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:03Z,use_quota=True,user_id='20998a99150d40e48a621efaf0372e0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Creating volume 796b3599-30d1-42b4-a832-9c463ea589b9 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:03 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" returned: 0 in 0.945s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:03 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9 1073741824 Apr 10 10:38:03 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:03 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a Apr 10 10:38:03 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:04 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9 1073741824" returned: 0 in 0.898s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:04 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9 Apr 10 10:38:04 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:04 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a" returned: 0 in 0.982s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:04 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a Apr 10 10:38:04 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:05 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9" returned: 0 in 0.658s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bbe9ba-a811-41fe-bfdf-8cfaa63b2263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-796b3599-30d1-42b4-a832-9c463ea589b9', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cb55c9-ec39-443b-9130-af4a316c7bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:05 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Volume volume-796b3599-30d1-42b4-a832-9c463ea589b9 (796b3599-30d1-42b4-a832-9c463ea589b9): created successfully Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cb55c9-ec39-443b-9130-af4a316c7bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Flow 'volume_create_manager' (7e6db652-ada5-46df-b8e9-7fcbd6292cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-84c4c29b-ddb4-4dac-be82-58ad8f9007d9 tempest-VolumesNegativeTest-1395056138 None] Created volume successfully. Apr 10 10:38:05 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff.152c9fd5-ae68-4b09-926d-879136289b0a" returned: 0 in 0.796s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-152c9fd5-ae68-4b09-926d-879136289b0a" released by "_delete_snapshot" :: held 3.598s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" released by "delete_snapshot" :: held 3.623s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Created reservations ['5ae48f3b-f216-4c03-9794-793307201ef4', 'b2cbf997-1406-4016-bbf9-3e4a749edd0c', '199fc860-efc0-46e1-93be-484e20d8be55', 'bf45f66a-757c-4ce7-8300-a5ee4e229911'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Delete snapshot completed successfully. Apr 10 10:38:05 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3781e4e4-4ced-41ed-851f-c01c35339f51 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-152c9fd5-ae68-4b09-926d-879136289b0a-delete_snapshot" released by "delete_snapshot" :: held 3.846s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-quobyte-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:06 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b3b3bf-3ce3-499a-b57a-a35a4baa0377]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:06 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff Apr 10 10:38:06 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Flow 'volume_create_manager' (3987b8af-6db0-4546-aea0-65cd2c00cd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b522720d-6d57-4114-9a87-c2e7cd191c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b522720d-6d57-4114-9a87-c2e7cd191c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1032631160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe2164e-c773-4a38-aec8-aa0d06b7bb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d9e21b7a4942ac8d22953ad8b918e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:07Z,use_quota=True,user_id='9b393cd17ab946b999b90e07b9d1ed70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022116ca-173c-460c-8d79-18f461db2388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022116ca-173c-460c-8d79-18f461db2388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693c6d48-e927-4aac-8623-6e889286062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693c6d48-e927-4aac-8623-6e889286062c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe2164e-c773-4a38-aec8-aa0d06b7bb09', 'volume_name': 'volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf98982-c459-461f-ada6-33b2ef1dd75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf98982-c459-461f-ada6-33b2ef1dd75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce23a73-6b25-44ac-a7c1-a314fed346d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Volume bbe2164e-c773-4a38-aec8-aa0d06b7bb09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09', 'volume_size': 1} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1032631160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe2164e-c773-4a38-aec8-aa0d06b7bb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d9e21b7a4942ac8d22953ad8b918e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:07Z,use_quota=True,user_id='9b393cd17ab946b999b90e07b9d1ed70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Creating volume bbe2164e-c773-4a38-aec8-aa0d06b7bb09 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:07 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:07 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" returned: 0 in 1.085s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:07 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09 1073741824 Apr 10 10:38:07 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:07 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff Apr 10 10:38:07 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Flow 'volume_create_manager' (e6f74e59-90b8-4c65-8260-36078af8623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b80abf7-b214-4914-8a0d-072938d9f628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b80abf7-b214-4914-8a0d-072938d9f628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-600445387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0351f3-73b1-40e1-975e-ec812e33b1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d9e21b7a4942ac8d22953ad8b918e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:08Z,use_quota=True,user_id='9b393cd17ab946b999b90e07b9d1ed70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bad6cf4-c743-4cc5-a7f6-155a16c9a463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bad6cf4-c743-4cc5-a7f6-155a16c9a463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e55b29-7a40-49fb-97a1-3beac7e916fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e55b29-7a40-49fb-97a1-3beac7e916fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0351f3-73b1-40e1-975e-ec812e33b1b3', 'volume_name': 'volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fc4374-94e6-42fa-8058-f375c3b51912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fc4374-94e6-42fa-8058-f375c3b51912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63545673-1b10-4d09-9e30-881bf667b304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Volume 3c0351f3-73b1-40e1-975e-ec812e33b1b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3', 'volume_size': 1} Apr 10 10:38:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Flow 'volume_create_manager' (be35628a-016d-4d32-bc3e-fba7d89473ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db75c7e2-89d5-491f-a282-502708b2aad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db75c7e2-89d5-491f-a282-502708b2aad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-789267688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81b955c-806b-4dce-8591-2412c00eddc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d9e21b7a4942ac8d22953ad8b918e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:08Z,use_quota=True,user_id='9b393cd17ab946b999b90e07b9d1ed70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e69001-685d-4370-bc2d-6ba91b9e474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e69001-685d-4370-bc2d-6ba91b9e474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3440513-9da3-417d-a01b-847ae376274b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3440513-9da3-417d-a01b-847ae376274b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b81b955c-806b-4dce-8591-2412c00eddc2', 'volume_name': 'volume-b81b955c-806b-4dce-8591-2412c00eddc2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bfb5de-eb7d-454b-88e5-6567122276e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bfb5de-eb7d-454b-88e5-6567122276e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a05d749-fafd-4301-8465-ffbd8f91d994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Volume b81b955c-806b-4dce-8591-2412c00eddc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b81b955c-806b-4dce-8591-2412c00eddc2', 'volume_size': 1} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09 1073741824" returned: 0 in 0.907s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:08 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09 Apr 10 10:38:08 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:08 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" returned: 0 in 1.034s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff" released by "delete_volume" :: held 2.183s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Created reservations ['98c0b574-9873-425d-8f57-15d16f5abbc3', 'f9248cc7-cf4b-43ff-b4d0-30732441104f', 'ae4f1518-7338-4935-8cc9-6d14ac4b154f', '605bc089-9489-4131-aa59-037885631003'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Flow 'volume_create_manager' (7b9badf1-8790-4109-97a7-ed7dbd41f3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f7313b-d442-4c1e-8c62-b55211f583a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f7313b-d442-4c1e-8c62-b55211f583a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665937944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873ce350-247f-4ddf-855e-82f3c11eae4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d9e21b7a4942ac8d22953ad8b918e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:08Z,use_quota=True,user_id='9b393cd17ab946b999b90e07b9d1ed70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c679976-81ba-42e3-b1f4-fa0f516a738f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c679976-81ba-42e3-b1f4-fa0f516a738f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dc7432-b5c9-4b87-b161-e6052f47b1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dc7432-b5c9-4b87-b161-e6052f47b1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873ce350-247f-4ddf-855e-82f3c11eae4b', 'volume_name': 'volume-873ce350-247f-4ddf-855e-82f3c11eae4b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61909c38-8a3b-4fca-848f-150ac10b1f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61909c38-8a3b-4fca-848f-150ac10b1f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e5f919-3da0-43e3-99de-e1fa69be627c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Volume 873ce350-247f-4ddf-855e-82f3c11eae4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873ce350-247f-4ddf-855e-82f3c11eae4b', 'volume_size': 1} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:08 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:08 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:08 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09" returned: 0 in 0.653s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-600445387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c0351f3-73b1-40e1-975e-ec812e33b1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d9e21b7a4942ac8d22953ad8b918e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:08Z,use_quota=True,user_id='9b393cd17ab946b999b90e07b9d1ed70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Creating volume 3c0351f3-73b1-40e1-975e-ec812e33b1b3 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:08 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce23a73-6b25-44ac-a7c1-a314fed346d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6a46d2-5955-4e80-be7f-6f8d94d35370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3 1073741824 Apr 10 10:38:08 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:08 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Volume volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09 (bbe2164e-c773-4a38-aec8-aa0d06b7bb09): created successfully Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6a46d2-5955-4e80-be7f-6f8d94d35370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Flow 'volume_create_manager' (3987b8af-6db0-4546-aea0-65cd2c00cd9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:08 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Flow 'volume_create_manager' (971abd9b-671e-4276-88b2-b98ce568aca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28087b5-bfa8-473b-924f-8e093cad324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28087b5-bfa8-473b-924f-8e093cad324f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1075423379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80cb4c34-08cc-4c58-a858-b1d3d4d02a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d9e21b7a4942ac8d22953ad8b918e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:09Z,use_quota=True,user_id='9b393cd17ab946b999b90e07b9d1ed70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aeee8b9-ae11-44b1-9541-af5c345916c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aeee8b9-ae11-44b1-9541-af5c345916c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def375de-247e-47f5-a3f5-ece6f008f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def375de-247e-47f5-a3f5-ece6f008f456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80cb4c34-08cc-4c58-a858-b1d3d4d02a51', 'volume_name': 'volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21be92df-b0e0-4693-9501-200dafbc5970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21be92df-b0e0-4693-9501-200dafbc5970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ffe37e-db22-42eb-933f-aa3b44e91379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Volume 80cb4c34-08cc-4c58-a858-b1d3d4d02a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51', 'volume_size': 1} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e10241da-4e3c-45b3-a1ab-f8b31f2a044f tempest-CreateVolumesFromImageTest-1836240635 None] Created volume successfully. Apr 10 10:38:09 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.665s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Deleted volume successfully. Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a0ff86b4-a315-484d-be0c-bd64a401b5f1 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-0e0dc268-b1c5-42e8-88e0-8b16bcee98ff-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:09 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3 1073741824" returned: 0 in 0.743s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:09 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3 Apr 10 10:38:09 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Flow 'volume_create_manager' (f828f3f1-6f0d-44b6-be78-ab4b4d5d0457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e946920-2a13-4e2d-af0b-e614275f8be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e946920-2a13-4e2d-af0b-e614275f8be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1776033134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ebee88-5676-4352-925a-aff3313e3ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91de0a6ba654e409ca3a9c7d59699ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:10Z,use_quota=True,user_id='6f5751d05f9749d1912e9f1cd3e0075f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69a8fb7-896a-46bf-afa2-40ff47c82f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69a8fb7-896a-46bf-afa2-40ff47c82f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52114888-0f4d-4217-bbeb-d6b2c66b84fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52114888-0f4d-4217-bbeb-d6b2c66b84fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ebee88-5676-4352-925a-aff3313e3ede', 'volume_name': 'volume-46ebee88-5676-4352-925a-aff3313e3ede', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568a61f0-b03c-4d0f-a0d7-44ef817024d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568a61f0-b03c-4d0f-a0d7-44ef817024d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96001e2-c17c-44c4-b7ca-52d174351a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Volume 46ebee88-5676-4352-925a-aff3313e3ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ebee88-5676-4352-925a-aff3313e3ede', 'volume_size': 1} Apr 10 10:38:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:10 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3" returned: 0 in 0.558s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.037s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-789267688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81b955c-806b-4dce-8591-2412c00eddc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d9e21b7a4942ac8d22953ad8b918e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:08Z,use_quota=True,user_id='9b393cd17ab946b999b90e07b9d1ed70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Creating volume b81b955c-806b-4dce-8591-2412c00eddc2 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:10 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63545673-1b10-4d09-9e30-881bf667b304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:10 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2 1073741824 Apr 10 10:38:10 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (783ab122-06de-4471-97ff-94f33f4afac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:10 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Volume volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3 (3c0351f3-73b1-40e1-975e-ec812e33b1b3): created successfully Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (783ab122-06de-4471-97ff-94f33f4afac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Flow 'volume_create_manager' (e6f74e59-90b8-4c65-8260-36078af8623e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e4189d43-68ef-47d2-a3f9-e417ea074a16 tempest-CreateVolumesFromImageTest-1836240635 None] Created volume successfully. Apr 10 10:38:10 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2 1073741824" returned: 0 in 0.668s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:10 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2 Apr 10 10:38:10 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:11 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2" returned: 0 in 0.659s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.961s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665937944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873ce350-247f-4ddf-855e-82f3c11eae4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d9e21b7a4942ac8d22953ad8b918e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:08Z,use_quota=True,user_id='9b393cd17ab946b999b90e07b9d1ed70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Creating volume 873ce350-247f-4ddf-855e-82f3c11eae4b {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:11 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:11 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b 1073741824 Apr 10 10:38:11 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a05d749-fafd-4301-8465-ffbd8f91d994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81b955c-806b-4dce-8591-2412c00eddc2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4b0e6a-add8-4ac6-bda4-78008980ab56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Volume volume-b81b955c-806b-4dce-8591-2412c00eddc2 (b81b955c-806b-4dce-8591-2412c00eddc2): created successfully Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4b0e6a-add8-4ac6-bda4-78008980ab56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Flow 'volume_create_manager' (be35628a-016d-4d32-bc3e-fba7d89473ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:11 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6f906e06-613f-4adb-ac73-8ae03b6130c6 tempest-CreateVolumesFromImageTest-1836240635 None] Created volume successfully. Apr 10 10:38:12 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b 1073741824" returned: 0 in 0.801s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:12 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b Apr 10 10:38:12 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:13 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b" returned: 0 in 0.598s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.951s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1075423379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80cb4c34-08cc-4c58-a858-b1d3d4d02a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8d9e21b7a4942ac8d22953ad8b918e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:09Z,use_quota=True,user_id='9b393cd17ab946b999b90e07b9d1ed70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Creating volume 80cb4c34-08cc-4c58-a858-b1d3d4d02a51 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:13 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e5f919-3da0-43e3-99de-e1fa69be627c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873ce350-247f-4ddf-855e-82f3c11eae4b', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cd463a-c9a7-4180-a6cc-715c68a090c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:13 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51 1073741824 Apr 10 10:38:13 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:13 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Volume volume-873ce350-247f-4ddf-855e-82f3c11eae4b (873ce350-247f-4ddf-855e-82f3c11eae4b): created successfully Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cd463a-c9a7-4180-a6cc-715c68a090c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Flow 'volume_create_manager' (7b9badf1-8790-4109-97a7-ed7dbd41f3d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:13 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4780a6fb-9a23-4481-9049-ab80dda97ecc tempest-CreateVolumesFromImageTest-1836240635 None] Created volume successfully. Apr 10 10:38:13 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51 1073741824" returned: 0 in 0.659s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:13 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51 Apr 10 10:38:13 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:14 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51" returned: 0 in 0.753s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.546s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1776033134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ebee88-5676-4352-925a-aff3313e3ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91de0a6ba654e409ca3a9c7d59699ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:10Z,use_quota=True,user_id='6f5751d05f9749d1912e9f1cd3e0075f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Creating volume 46ebee88-5676-4352-925a-aff3313e3ede {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:14 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ffe37e-db22-42eb-933f-aa3b44e91379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6fe8e9-6e54-45e3-925f-7744d04b5514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:14 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Volume volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51 (80cb4c34-08cc-4c58-a858-b1d3d4d02a51): created successfully Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6fe8e9-6e54-45e3-925f-7744d04b5514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:14 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede 1073741824 Apr 10 10:38:14 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Flow 'volume_create_manager' (971abd9b-671e-4276-88b2-b98ce568aca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-97ba81f5-b9fd-4edb-872e-36f546253de3 tempest-CreateVolumesFromImageTest-1836240635 None] Created volume successfully. Apr 10 10:38:15 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede 1073741824" returned: 0 in 0.798s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:15 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede Apr 10 10:38:15 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "cinder-80cb4c34-08cc-4c58-a858-b1d3d4d02a51-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-80cb4c34-08cc-4c58-a858-b1d3d4d02a51-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "cinder-quobyte-80cb4c34-08cc-4c58-a858-b1d3d4d02a51" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-quobyte-80cb4c34-08cc-4c58-a858-b1d3d4d02a51" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[869f08b9-2543-4412-b8f2-3b348f606bdb]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:15 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51 Apr 10 10:38:15 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:16 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede" returned: 0 in 0.695s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96001e2-c17c-44c4-b7ca-52d174351a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ebee88-5676-4352-925a-aff3313e3ede', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92faf0b1-2f1a-4b7e-8aff-6757272a5418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:16 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Volume volume-46ebee88-5676-4352-925a-aff3313e3ede (46ebee88-5676-4352-925a-aff3313e3ede): created successfully Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92faf0b1-2f1a-4b7e-8aff-6757272a5418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Flow 'volume_create_manager' (f828f3f1-6f0d-44b6-be78-ab4b4d5d0457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-04c054c0-bf00-43c5-bf62-6200316638b8 tempest-VolumeDependencyTests-80356891 None] Created volume successfully. Apr 10 10:38:16 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51" returned: 0 in 0.725s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:16 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51 Apr 10 10:38:16 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Flow 'volume_create_manager' (1d6e8843-7f79-4283-a670-5892b82630d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fb9895-9858-4b39-ab60-abc434e60861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fb9895-9858-4b39-ab60-abc434e60861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1131073269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adca48cf-75cd-4d98-afe8-6dba411fee65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91de0a6ba654e409ca3a9c7d59699ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=46ebee88-5676-4352-925a-aff3313e3ede,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:17Z,use_quota=True,user_id='6f5751d05f9749d1912e9f1cd3e0075f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a50081-540d-4e69-b8a5-8fc943e52563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a50081-540d-4e69-b8a5-8fc943e52563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db869c2-ad6f-4b2c-b568-c4c2863ec4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db869c2-ad6f-4b2c-b568-c4c2863ec4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'adca48cf-75cd-4d98-afe8-6dba411fee65', 'volume_name': 'volume-adca48cf-75cd-4d98-afe8-6dba411fee65', 'volume_size': 1, 'source_volid': '46ebee88-5676-4352-925a-aff3313e3ede', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acc8d7c-6d2d-4928-8acf-05c3cbbcf63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:17 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acc8d7c-6d2d-4928-8acf-05c3cbbcf63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d8ff06-5d92-493c-9314-8c0f8a0995ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:17 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Volume adca48cf-75cd-4d98-afe8-6dba411fee65: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-adca48cf-75cd-4d98-afe8-6dba411fee65', 'volume_size': 1, 'source_volid': '46ebee88-5676-4352-925a-aff3313e3ede', 'source_volstatus': 'available'} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-80cb4c34-08cc-4c58-a858-b1d3d4d02a51" returned: 0 in 0.671s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:17 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Cloning volume 46ebee88-5676-4352-925a-aff3313e3ede to volume adca48cf-75cd-4d98-afe8-6dba411fee65 Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-quobyte-80cb4c34-08cc-4c58-a858-b1d3d4d02a51" released by "delete_volume" :: held 1.433s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Creating offline snapshot f6299abd-7bf1-4d38-8bba-072d07855b85 of volume 46ebee88-5676-4352-925a-aff3313e3ede {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d8fc55-b24e-4cec-ab76-c1b9631833fc]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Created reservations ['15caadc9-3d1c-4145-ab5f-09b5408e7b45', 'e82aa5dd-c0a4-4480-9790-1dc640a161bb', 'd0c90c93-9fd1-41f5-aac5-c230d71a3b0e', '76dd5e1b-726c-42ef-8495-2cd04ca44040'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:17 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede Apr 10 10:38:17 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:17 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:17 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:17 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.688s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Deleted volume successfully. Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ddb165a5-4923-4f1a-ad39-fb63e9932e4b tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-80cb4c34-08cc-4c58-a858-b1d3d4d02a51-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "cinder-873ce350-247f-4ddf-855e-82f3c11eae4b-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-873ce350-247f-4ddf-855e-82f3c11eae4b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:18 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede" returned: 0 in 0.904s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:18 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 1G Apr 10 10:38:18 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "cinder-quobyte-873ce350-247f-4ddf-855e-82f3c11eae4b" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-quobyte-873ce350-247f-4ddf-855e-82f3c11eae4b" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:18 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf894bf7-f61f-4cce-8eac-667b3437b439]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:18 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b Apr 10 10:38:18 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:18 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 1G" returned: 0 in 0.791s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ebee88-5676-4352-925a-aff3313e3ede -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:18 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ebee88-5676-4352-925a-aff3313e3ede -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 Apr 10 10:38:18 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:19 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b" returned: 0 in 0.853s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:19 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b Apr 10 10:38:19 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:19 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ebee88-5676-4352-925a-aff3313e3ede -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85" returned: 0 in 0.584s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:19 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 is being set with open permissions: ugo+rw Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:19 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 Apr 10 10:38:19 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:19 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-873ce350-247f-4ddf-855e-82f3c11eae4b" returned: 0 in 0.600s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-quobyte-873ce350-247f-4ddf-855e-82f3c11eae4b" released by "delete_volume" :: held 1.484s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Created reservations ['664f7c8b-aefd-428d-87b3-616ecedff156', '49b01f33-9622-4b48-b098-cdc9eb5c93b1', 'e8a81f0d-ff53-4fb8-984e-c4e74d7797a1', '61d0366c-b73f-423e-977b-64b82d463e2d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:19 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:19 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:20 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85" returned: 0 in 0.621s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:20 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.info Apr 10 10:38:20 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "cinder-b81b955c-806b-4dce-8591-2412c00eddc2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-b81b955c-806b-4dce-8591-2412c00eddc2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "cinder-quobyte-b81b955c-806b-4dce-8591-2412c00eddc2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-quobyte-b81b955c-806b-4dce-8591-2412c00eddc2" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edaef31-73dd-438e-858b-397d3b071a7c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:20 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2 Apr 10 10:38:20 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:20 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.622s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Deleted volume successfully. Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e2906989-e8e2-4a29-aa82-ca0443bb0981 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-873ce350-247f-4ddf-855e-82f3c11eae4b-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:20 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.info" returned: 0 in 0.843s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:20 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.info is being set with open permissions: ugo+rw Apr 10 10:38:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:20 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.info Apr 10 10:38:20 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:21 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2" returned: 0 in 1.130s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:21 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2 Apr 10 10:38:21 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:21 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.info" returned: 0 in 0.906s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-quobyte-adca48cf-75cd-4d98-afe8-6dba411fee65" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-adca48cf-75cd-4d98-afe8-6dba411fee65" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] snapshot: f6299abd-7bf1-4d38-8bba-072d07855b85, volume: adca48cf-75cd-4d98-afe8-6dba411fee65, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58840f1-d371-4145-8293-fb7cc5039ac5]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:21 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 Apr 10 10:38:21 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:22 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b81b955c-806b-4dce-8591-2412c00eddc2" returned: 0 in 0.673s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-quobyte-b81b955c-806b-4dce-8591-2412c00eddc2" released by "delete_volume" :: held 1.837s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Created reservations ['e8dd0c18-a7e6-4728-bb42-eded7786d5ef', '2bccb018-b410-474d-8398-2f2b9a34a20d', '89d8271d-c8f1-4ce4-b435-fadf8ad99997', 'a8c85506-b6ee-420e-bda1-38fc598a85dd'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:22 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:22 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:22 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "cinder-3c0351f3-73b1-40e1-975e-ec812e33b1b3-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46ebee88-5676-4352-925a-aff3313e3ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-3c0351f3-73b1-40e1-975e-ec812e33b1b3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[294a775d-b3d0-4135-87ad-d067d621aeb9]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "cinder-quobyte-3c0351f3-73b1-40e1-975e-ec812e33b1b3" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-quobyte-3c0351f3-73b1-40e1-975e-ec812e33b1b3" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0440b0e3-2453-4379-a793-1c3cd1006957]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:22 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede Apr 10 10:38:22 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:22 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3 Apr 10 10:38:22 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:23 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.709s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:23 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Deleted volume successfully. Apr 10 10:38:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-99966383-133d-425f-973d-ba76b353a645 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-b81b955c-806b-4dce-8591-2412c00eddc2-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:23 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede" returned: 0 in 0.787s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:23 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:38:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:23 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65 Apr 10 10:38:23 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:23 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3" returned: 0 in 0.835s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:23 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3 Apr 10 10:38:23 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:24 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3c0351f3-73b1-40e1-975e-ec812e33b1b3" returned: 0 in 0.804s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-quobyte-3c0351f3-73b1-40e1-975e-ec812e33b1b3" released by "delete_volume" :: held 1.694s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:24 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Created reservations ['e95503c5-a93c-4cb9-9247-83d32099ba41', '7f85ae91-3077-4bce-b89e-aef98bb51244', '69d83bf6-a39a-40de-ab99-3a6e2e3a3074', 'a802df8e-7f70-4f04-bc49-3c7aa2d37fa4'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:24 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:24 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "cinder-bbe2164e-c773-4a38-aec8-aa0d06b7bb09-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-bbe2164e-c773-4a38-aec8-aa0d06b7bb09-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "cinder-quobyte-bbe2164e-c773-4a38-aec8-aa0d06b7bb09" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-quobyte-bbe2164e-c773-4a38-aec8-aa0d06b7bb09" acquired by "delete_volume" :: waited 0.082s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:25 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a318d2f-4518-4f5d-81b8-6102392f127c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:25 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09 Apr 10 10:38:25 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:26 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65" returned: 0 in 3.472s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6aefb4-0c0f-46a6-a172-9baa5f4e700e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:26 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 2.356s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:26 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Deleted volume successfully. Apr 10 10:38:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e21392b-e836-4334-a39c-72614ecf3379 tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-3c0351f3-73b1-40e1-975e-ec812e33b1b3-delete_volume" released by "delete_volume" :: held 4.354s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:27 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09" returned: 0 in 1.822s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:27 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede Apr 10 10:38:27 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:27 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09 Apr 10 10:38:27 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:27 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bbe2164e-c773-4a38-aec8-aa0d06b7bb09" returned: 0 in 0.662s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-quobyte-bbe2164e-c773-4a38-aec8-aa0d06b7bb09" released by "delete_volume" :: held 2.550s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Created reservations ['92988cdc-7047-40dc-8299-05191808b9ef', '81fac78a-76a0-4f74-8d58-71f9743e0676', '9b0f3abb-631a-4279-a0f5-619d395cfc47', '1007190d-7e6a-43bd-9752-23e7fc063841'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:27 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:27 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:27 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede" returned: 0 in 1.006s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede, size 1024.00 MB, duration 3.47 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:38:27 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Converted 1024.00 MB image at 294.74 MB/s Apr 10 10:38:27 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65 is being set with open permissions: ugo+rw Apr 10 10:38:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:27 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65 Apr 10 10:38:27 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:28 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65" returned: 0 in 0.509s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-adca48cf-75cd-4d98-afe8-6dba411fee65" released by "_copy_volume_from_snapshot" :: held 6.487s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:28 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.573s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:28 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-quobyte-f6299abd-7bf1-4d38-8bba-072d07855b85" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Deleted volume successfully. Apr 10 10:38:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0c6cb619-36c5-456c-9f9e-219d7c45c1bf tempest-CreateVolumesFromImageTest-1836240635 None] Lock "cinder-bbe2164e-c773-4a38-aec8-aa0d06b7bb09-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-f6299abd-7bf1-4d38-8bba-072d07855b85" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Deleting offline snapshot f6299abd-7bf1-4d38-8bba-072d07855b85 of volume 46ebee88-5676-4352-925a-aff3313e3ede {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:28 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] snapshot_file for this snap is: volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:28 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3829e23d-1962-426b-a421-86a8cce07e16]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:28 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 Apr 10 10:38:28 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:29 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85" returned: 0 in 0.652s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46ebee88-5676-4352-925a-aff3313e3ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbb022f-8366-4e83-8cc6-9c123098d466]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:29 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede Apr 10 10:38:29 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:29 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede" returned: 0 in 0.610s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:29 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 Apr 10 10:38:29 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:30 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85" returned: 0 in 0.573s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:30 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85 Apr 10 10:38:30 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:30 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede.f6299abd-7bf1-4d38-8bba-072d07855b85" returned: 0 in 0.546s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-f6299abd-7bf1-4d38-8bba-072d07855b85" released by "_delete_snapshot" :: held 2.437s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.758s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d8ff06-5d92-493c-9314-8c0f8a0995ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adca48cf-75cd-4d98-afe8-6dba411fee65', 'volume_size': 1, 'source_volid': '46ebee88-5676-4352-925a-aff3313e3ede', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e9cf82-b366-4e89-a017-7fbcb19f3831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:30 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Volume volume-adca48cf-75cd-4d98-afe8-6dba411fee65 (adca48cf-75cd-4d98-afe8-6dba411fee65): created successfully Apr 10 10:38:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e9cf82-b366-4e89-a017-7fbcb19f3831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:30 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Flow 'volume_create_manager' (1d6e8843-7f79-4283-a670-5892b82630d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-76b4afce-6998-4dbe-b1f7-1dc1d695d341 tempest-VolumeDependencyTests-80356891 None] Created volume successfully. Apr 10 10:38:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-46ebee88-5676-4352-925a-aff3313e3ede-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-46ebee88-5676-4352-925a-aff3313e3ede-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-quobyte-46ebee88-5676-4352-925a-aff3313e3ede" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-46ebee88-5676-4352-925a-aff3313e3ede" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:31 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c56d066-eade-497e-9865-9ab67df0c354]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:31 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede Apr 10 10:38:31 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:31 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede" returned: 0 in 0.614s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:32 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede Apr 10 10:38:32 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:32 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46ebee88-5676-4352-925a-aff3313e3ede" returned: 0 in 0.521s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-46ebee88-5676-4352-925a-aff3313e3ede" released by "delete_volume" :: held 1.197s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:32 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Created reservations ['8cdc3f2f-15ee-4ca2-926a-d90b38a6ceec', '6d44ad01-9d9d-4dce-81ed-a31fea0c7af7', '30ac2353-4611-4253-8fea-6531c2dbcf43', 'effcff7c-ae74-4db3-be4d-8cc5c080f3ae'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:32 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:32 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:33 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-adca48cf-75cd-4d98-afe8-6dba411fee65-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.787s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:33 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Deleted volume successfully. Apr 10 10:38:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-adca48cf-75cd-4d98-afe8-6dba411fee65-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bf70abb4-9fa4-4272-bc8b-58dc07b6e3f1 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-46ebee88-5676-4352-925a-aff3313e3ede-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-quobyte-adca48cf-75cd-4d98-afe8-6dba411fee65" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-adca48cf-75cd-4d98-afe8-6dba411fee65" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4e1b1d-1e7a-4cda-9cb7-3b92a0eedd77]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:33 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65 Apr 10 10:38:33 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:34 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65" returned: 0 in 0.822s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:34 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65 Apr 10 10:38:34 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:34 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-adca48cf-75cd-4d98-afe8-6dba411fee65" returned: 0 in 0.564s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-adca48cf-75cd-4d98-afe8-6dba411fee65" released by "delete_volume" :: held 1.418s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Created reservations ['a81dfe7e-9f01-4f1e-a54f-45685f65a42c', 'a418ff71-df61-4911-9784-944af377e426', 'f1fadc57-5c83-403e-a66c-31e40a2fe9e0', 'd1f85d8d-d74f-44a1-abd6-fbcf2928e49b'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:35 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:35 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:35 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (9c18de92-5c94-4177-9e60-8147c54dc4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be57e1a-e7be-4eb8-aa25-11b7ac054a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.674s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be57e1a-e7be-4eb8-aa25-11b7ac054a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1008890639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a799c6-0d6e-4a1b-ac57-4e68f9130039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:36Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc927fea-4a1d-438e-af78-a669a76c4e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc927fea-4a1d-438e-af78-a669a76c4e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a58a35-f486-48df-8710-71ff174bc4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a58a35-f486-48df-8710-71ff174bc4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a799c6-0d6e-4a1b-ac57-4e68f9130039', 'volume_name': 'volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84efefb3-f6b4-462b-a299-3964a59bd42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84efefb3-f6b4-462b-a299-3964a59bd42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3be8a3b-21ad-4204-bebe-22d0899293ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:35 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Volume 86a799c6-0d6e-4a1b-ac57-4e68f9130039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039', 'volume_size': 1} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1008890639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a799c6-0d6e-4a1b-ac57-4e68f9130039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:36Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Creating volume 86a799c6-0d6e-4a1b-ac57-4e68f9130039 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:35 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:35 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Deleted volume successfully. Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-aa8841b6-1832-476d-b1db-61a088492334-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Lock "cinder-aa8841b6-1832-476d-b1db-61a088492334-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0fe57638-cc9b-45fb-821a-6f16df23ab50 tempest-VolumeDependencyTests-80356891 None] Lock "cinder-adca48cf-75cd-4d98-afe8-6dba411fee65-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:35 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039 1073741824 Apr 10 10:38:35 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Acquiring lock "cinder-quobyte-aa8841b6-1832-476d-b1db-61a088492334" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-aa8841b6-1832-476d-b1db-61a088492334" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceb8c82-db82-47f8-935d-7681f7f6b9bf]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:36 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334 Apr 10 10:38:36 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:36 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334" returned: 0 in 0.670s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:36 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334 Apr 10 10:38:36 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:36 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039 1073741824" returned: 0 in 0.846s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:36 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039 Apr 10 10:38:36 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Acquiring lock "cinder-796b3599-30d1-42b4-a832-9c463ea589b9-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Lock "cinder-796b3599-30d1-42b4-a832-9c463ea589b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Acquiring lock "cinder-quobyte-796b3599-30d1-42b4-a832-9c463ea589b9" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Lock "cinder-quobyte-796b3599-30d1-42b4-a832-9c463ea589b9" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[387d2bf1-28c2-49e4-8bfa-b106d78d7b7c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:37 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9 Apr 10 10:38:37 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:37 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039" returned: 0 in 0.536s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3be8a3b-21ad-4204-bebe-22d0899293ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c606d38-6290-46aa-be9c-579510456eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:37 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Volume volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039 (86a799c6-0d6e-4a1b-ac57-4e68f9130039): created successfully Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c606d38-6290-46aa-be9c-579510456eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (9c18de92-5c94-4177-9e60-8147c54dc4cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-41ac3e38-5f12-4e58-94a8-d33aea29c681 tempest-VolumesActionsTest-318027248 None] Created volume successfully. Apr 10 10:38:37 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-aa8841b6-1832-476d-b1db-61a088492334" returned: 0 in 0.659s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Lock "cinder-quobyte-aa8841b6-1832-476d-b1db-61a088492334" released by "delete_volume" :: held 1.378s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Created reservations ['764b041a-8338-48e1-9623-cc79e6a419bc', '469c3e19-45bc-4568-b4e8-a036d1133d85', 'd76c881d-0fa7-4288-8eb5-2f38fbb99500', '403f2e70-3f9f-491b-93b3-9f95246c76a7'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:37 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:37 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:37 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9" returned: 0 in 0.735s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:37 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9 Apr 10 10:38:37 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bde9fd9a-73c4-446d-8d24-575bdaa465b6 tempest-VolumesActionsTest-318027248 None] Acquiring lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039" by "attach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bde9fd9a-73c4-446d-8d24-575bdaa465b6 tempest-VolumesActionsTest-318027248 None] Lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039" acquired by "attach_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bde9fd9a-73c4-446d-8d24-575bdaa465b6 tempest-VolumesActionsTest-318027248 None] Attaching volume 86a799c6-0d6e-4a1b-ac57-4e68f9130039 to instance 74f22c37-962a-4120-aab0-7ecc55efef87 at mountpoint /dev/vdb on host None. Apr 10 10:38:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bde9fd9a-73c4-446d-8d24-575bdaa465b6 tempest-VolumesActionsTest-318027248 None] Attach volume completed successfully. Apr 10 10:38:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bde9fd9a-73c4-446d-8d24-575bdaa465b6 tempest-VolumesActionsTest-318027248 None] Lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039" released by "attach_volume" :: held 0.104s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:38 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.655s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Deleted volume successfully. Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-239b73af-8d73-407b-acdf-5d2b0587cf6f tempest-VolumeDependencyTests-80356891 None] Lock "cinder-aa8841b6-1832-476d-b1db-61a088492334-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:38 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-796b3599-30d1-42b4-a832-9c463ea589b9" returned: 0 in 0.560s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Lock "cinder-quobyte-796b3599-30d1-42b4-a832-9c463ea589b9" released by "delete_volume" :: held 1.335s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Created reservations ['8596386c-4add-4511-afed-11bdb9e5b9aa', 'a57a81f3-dd66-4bf0-9dcc-6100c4d36286', 'ca0ff3e0-beb7-42e3-b444-002bebe3e24b', 'cbc67fa4-48d7-4183-95e8-dd8de34ab3a0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:38 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:38 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0d3db469-13b2-45b9-93bf-cbdfe4ff95e7 tempest-VolumesActionsTest-1570800517 None] Terminate volume connection completed successfully. Apr 10 10:38:39 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.702s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:39 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Deleted volume successfully. Apr 10 10:38:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-abd47720-03ff-48fb-b773-57fff1394535 tempest-VolumesNegativeTest-1395056138 None] Lock "cinder-796b3599-30d1-42b4-a832-9c463ea589b9-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0d3db469-13b2-45b9-93bf-cbdfe4ff95e7 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039-detach_volume" by "detach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0d3db469-13b2-45b9-93bf-cbdfe4ff95e7 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0d3db469-13b2-45b9-93bf-cbdfe4ff95e7 tempest-VolumesActionsTest-1570800517 None] Detaching volume 86a799c6-0d6e-4a1b-ac57-4e68f9130039 from instance 74f22c37-962a-4120-aab0-7ecc55efef87. Apr 10 10:38:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0d3db469-13b2-45b9-93bf-cbdfe4ff95e7 tempest-VolumesActionsTest-1570800517 None] Detach volume completed successfully. Apr 10 10:38:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0d3db469-13b2-45b9-93bf-cbdfe4ff95e7 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bbb5be90-f104-4ee3-b542-183b78690989 tempest-VolumesActionsTest-318027248 None] Acquiring lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039-detach_volume" by "detach_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bbb5be90-f104-4ee3-b542-183b78690989 tempest-VolumesActionsTest-318027248 None] Lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:40 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bbb5be90-f104-4ee3-b542-183b78690989 tempest-VolumesActionsTest-318027248 None] Volume detach called, but volume not attached. Apr 10 10:38:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bbb5be90-f104-4ee3-b542-183b78690989 tempest-VolumesActionsTest-318027248 None] Lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Acquiring lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Acquiring lock "cinder-quobyte-86a799c6-0d6e-4a1b-ac57-4e68f9130039" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Lock "cinder-quobyte-86a799c6-0d6e-4a1b-ac57-4e68f9130039" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:41 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafaf3c6-52d4-4cfc-be4e-49702308e5cc]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:41 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039 Apr 10 10:38:41 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:42 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039" returned: 0 in 0.804s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:42 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039 Apr 10 10:38:42 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:42 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86a799c6-0d6e-4a1b-ac57-4e68f9130039" returned: 0 in 0.916s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Lock "cinder-quobyte-86a799c6-0d6e-4a1b-ac57-4e68f9130039" released by "delete_volume" :: held 1.772s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:43 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Created reservations ['8f5c1318-0728-4ae2-8054-78ae4e250cef', '002d718f-8f41-44a7-b358-334866fc7185', '2c6d3cf0-80f3-4083-b4d5-1e18d26d0872', '4b064aca-6770-4415-9f03-b172bcab5768'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:43 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:43 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:44 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.894s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:44 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Deleted volume successfully. Apr 10 10:38:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c1b333aa-86c4-47f2-9b0c-e1a91279a1b3 tempest-VolumesActionsTest-318027248 None] Lock "cinder-86a799c6-0d6e-4a1b-ac57-4e68f9130039-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=114,cinder:INSERT=47,cinder:UPDATE=164,cinder:DELETE=10 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Flow 'volume_create_manager' (92fbd220-a6b6-4ae0-b8b6-43f23e7e8207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64e8e7f-0e66-4991-a5ee-4093df091372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64e8e7f-0e66-4991-a5ee-4093df091372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-182250676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f105bd58-1f64-4ab0-8b69-3eb35d8a0261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44efd03c8b9c4eb78b2d8a7d9d35ff76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:53Z,use_quota=True,user_id='e89a29b8e49b41f39de9251205e064d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a5294b-1526-4b78-a567-51b2ea05bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a5294b-1526-4b78-a567-51b2ea05bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07cabd86-414c-4b01-8713-04e7522c8f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07cabd86-414c-4b01-8713-04e7522c8f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f105bd58-1f64-4ab0-8b69-3eb35d8a0261', 'volume_name': 'volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91310057-191c-4c19-a970-d1f39be29535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91310057-191c-4c19-a970-d1f39be29535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419a9dc1-4f90-4c41-a316-90e43988401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:53 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Volume f105bd58-1f64-4ab0-8b69-3eb35d8a0261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261', 'volume_size': 1} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-182250676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f105bd58-1f64-4ab0-8b69-3eb35d8a0261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44efd03c8b9c4eb78b2d8a7d9d35ff76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:53Z,use_quota=True,user_id='e89a29b8e49b41f39de9251205e064d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Creating volume f105bd58-1f64-4ab0-8b69-3eb35d8a0261 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:53 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:38:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:53 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 1073741824 Apr 10 10:38:53 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:54 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 1073741824" returned: 0 in 0.578s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:54 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 Apr 10 10:38:54 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (669ca945-10ce-442b-8ac7-7a8127d814ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1bf6fa-3a39-481b-ad98-dc462bd995c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de1bf6fa-3a39-481b-ad98-dc462bd995c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2048478695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72bad50-00a4-4485-9c9a-f8d64b7687e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:54Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585cd974-4fe3-43c6-bba4-5ea1cc1c104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585cd974-4fe3-43c6-bba4-5ea1cc1c104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518d73d1-ed56-4aa5-89fa-44ff27680e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518d73d1-ed56-4aa5-89fa-44ff27680e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72bad50-00a4-4485-9c9a-f8d64b7687e6', 'volume_name': 'volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafa496c-9efb-4ffa-b6e5-40e9fc1a601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafa496c-9efb-4ffa-b6e5-40e9fc1a601d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7932fa31-d540-472c-85b0-13279f715ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:54 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Volume b72bad50-00a4-4485-9c9a-f8d64b7687e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6', 'volume_size': 1} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:54 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261" returned: 0 in 0.525s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.211s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2048478695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72bad50-00a4-4485-9c9a-f8d64b7687e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:54Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Creating volume b72bad50-00a4-4485-9c9a-f8d64b7687e6 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:54 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419a9dc1-4f90-4c41-a316-90e43988401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d8e8c8-69ef-469a-8349-4c5aa73b3ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:54 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6 1073741824 Apr 10 10:38:54 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:54 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Volume volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 (f105bd58-1f64-4ab0-8b69-3eb35d8a0261): created successfully Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d8e8c8-69ef-469a-8349-4c5aa73b3ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Flow 'volume_create_manager' (92fbd220-a6b6-4ae0-b8b6-43f23e7e8207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ecd02932-b8b6-4e3a-bbcc-8d8b8592ea5c tempest-VolumesSnapshotTestJSON-1059589447 None] Created volume successfully. Apr 10 10:38:55 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6 1073741824" returned: 0 in 0.706s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:55 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6 Apr 10 10:38:55 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:55 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6" returned: 0 in 0.565s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.131s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:UPDATE=155,cinder:SELECT=109,cinder:INSERT=30,cinder:DELETE=14 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] Creating offline snapshot ec4d4749-e835-4604-bce7-039baf58eb85 of volume f105bd58-1f64-4ab0-8b69-3eb35d8a0261 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7932fa31-d540-472c-85b0-13279f715ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b024a21c-1c2f-4838-8cb4-ffe32f75e003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3d188a-8fe7-45d4-9028-c336ac151445]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:55 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Volume volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6 (b72bad50-00a4-4485-9c9a-f8d64b7687e6): created successfully Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b024a21c-1c2f-4838-8cb4-ffe32f75e003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:55 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (669ca945-10ce-442b-8ac7-7a8127d814ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6dc3a3ac-829e-4bbe-a4fb-8d1b340fd7b6 tempest-VolumesActionsTest-318027248 None] Created volume successfully. Apr 10 10:38:55 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 Apr 10 10:38:55 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:56 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261" returned: 0 in 0.682s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:56 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 1G Apr 10 10:38:56 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "cinder-b72bad50-00a4-4485-9c9a-f8d64b7687e6-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-b72bad50-00a4-4485-9c9a-f8d64b7687e6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "cinder-quobyte-b72bad50-00a4-4485-9c9a-f8d64b7687e6" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-quobyte-b72bad50-00a4-4485-9c9a-f8d64b7687e6" acquired by "delete_volume" :: waited 0.029s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[604f7fef-02a4-4007-908e-1d07deca185c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:57 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6 Apr 10 10:38:57 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:57 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 1G" returned: 0 in 0.654s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:57 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 Apr 10 10:38:57 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:57 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:57 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:57 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6" returned: 0 in 0.721s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:57 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6 Apr 10 10:38:57 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:57 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85" returned: 0 in 0.666s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:57 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 is being set with open permissions: ugo+rw Apr 10 10:38:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:57 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 Apr 10 10:38:57 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:58 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.609s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:58 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-b72bad50-00a4-4485-9c9a-f8d64b7687e6" returned: 0 in 0.568s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-quobyte-b72bad50-00a4-4485-9c9a-f8d64b7687e6" released by "delete_volume" :: held 1.322s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Created reservations ['40a96e09-3a25-46a4-b9a0-3a77364cb1f7', 'bc664c0e-5bb3-4820-8739-39aaa6a71d12', '36ee0b14-90fe-46f7-a1d2-f5b8ad6a2b06', '9f08a9f2-9705-4aa3-830d-b8b666a3bedd'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:58 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85" returned: 0 in 0.620s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:58 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:38:58 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:58 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.info Apr 10 10:38:58 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:59 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.565s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Deleted volume successfully. Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-14a2f93f-1625-4e8e-861a-c3773ea1cf88 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-b72bad50-00a4-4485-9c9a-f8d64b7687e6-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:59 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.info" returned: 0 in 0.680s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:59 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.info is being set with open permissions: ugo+rw Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:59 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.info Apr 10 10:38:59 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (11072295-af8e-47c1-b34b-a7b317000528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac918d3-94a7-4a38-9362-8e39b5a21911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac918d3-94a7-4a38-9362-8e39b5a21911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-885515052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0290f3da-c651-4ca8-b172-005b9487cd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:00Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679649f3-f181-4661-8cb2-ed000d7a2612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679649f3-f181-4661-8cb2-ed000d7a2612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2e8f81-a096-40ab-83a7-0c64f0527ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2e8f81-a096-40ab-83a7-0c64f0527ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0290f3da-c651-4ca8-b172-005b9487cd2c', 'volume_name': 'volume-0290f3da-c651-4ca8-b172-005b9487cd2c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9c303e-dbf6-4793-9f21-1f2ca5f290b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9c303e-dbf6-4793-9f21-1f2ca5f290b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37929f0b-d2b2-4c91-b333-dc7617da37b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:59 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Volume 0290f3da-c651-4ca8-b172-005b9487cd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0290f3da-c651-4ca8-b172-005b9487cd2c', 'volume_size': 1} Apr 10 10:38:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:00 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.info" returned: 0 in 0.755s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.158s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.156s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-885515052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0290f3da-c651-4ca8-b172-005b9487cd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:00Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Creating volume 0290f3da-c651-4ca8-b172-005b9487cd2c {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:00 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:00 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c 1073741824 Apr 10 10:39:00 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7780f555-1bc3-4229-8804-cc53764bff9b tempest-VolumesSnapshotTestJSON-1059589447 None] Create snapshot completed successfully Apr 10 10:39:00 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c 1073741824" returned: 0 in 0.818s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:00 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c Apr 10 10:39:00 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-ec4d4749-e835-4604-bce7-039baf58eb85-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-ec4d4749-e835-4604-bce7-039baf58eb85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-f105bd58-1f64-4ab0-8b69-3eb35d8a0261" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-f105bd58-1f64-4ab0-8b69-3eb35d8a0261" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-ec4d4749-e835-4604-bce7-039baf58eb85" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-ec4d4749-e835-4604-bce7-039baf58eb85" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Deleting offline snapshot ec4d4749-e835-4604-bce7-039baf58eb85 of volume f105bd58-1f64-4ab0-8b69-3eb35d8a0261 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] snapshot_file for this snap is: volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b38e96-8726-43e9-bb28-a7da4904795b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:01 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 Apr 10 10:39:01 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:01 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c" returned: 0 in 0.510s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37929f0b-d2b2-4c91-b333-dc7617da37b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0290f3da-c651-4ca8-b172-005b9487cd2c', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afa46ee-05a5-472e-998c-3c737b570d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:01 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Volume volume-0290f3da-c651-4ca8-b172-005b9487cd2c (0290f3da-c651-4ca8-b172-005b9487cd2c): created successfully Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2afa46ee-05a5-472e-998c-3c737b570d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (11072295-af8e-47c1-b34b-a7b317000528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:01 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-241a5149-42cc-4ce7-ae5b-a2fb36168d08 tempest-VolumesActionsTest-318027248 None] Created volume successfully. Apr 10 10:39:01 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85" returned: 0 in 0.680s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[13754a61-ebcc-400e-be9b-1d8d10d4d269]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "cinder-0290f3da-c651-4ca8-b172-005b9487cd2c-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-0290f3da-c651-4ca8-b172-005b9487cd2c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:02 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 Apr 10 10:39:02 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "cinder-quobyte-0290f3da-c651-4ca8-b172-005b9487cd2c" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-quobyte-0290f3da-c651-4ca8-b172-005b9487cd2c" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:02 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5010e5c-d70f-462a-ae2d-780effeeee08]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:02 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c Apr 10 10:39:02 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:02 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261" returned: 0 in 0.796s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:02 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 Apr 10 10:39:02 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:03 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c" returned: 0 in 0.806s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:03 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c Apr 10 10:39:03 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:03 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85" returned: 0 in 0.698s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:03 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85 Apr 10 10:39:03 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:03 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-0290f3da-c651-4ca8-b172-005b9487cd2c" returned: 0 in 0.543s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-quobyte-0290f3da-c651-4ca8-b172-005b9487cd2c" released by "delete_volume" :: held 1.380s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Created reservations ['5936f26e-f413-44e0-be15-38f4cf00d1dc', '8afa9f25-9441-48b1-83ad-e7223dc684bd', '0d9a4419-53a2-4483-b507-419b903ad64b', '04f0710e-3c31-452a-b014-f97bccbb6d0a'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:03 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:03 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:04 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261.ec4d4749-e835-4604-bce7-039baf58eb85" returned: 0 in 0.525s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-ec4d4749-e835-4604-bce7-039baf58eb85" released by "_delete_snapshot" :: held 2.794s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-f105bd58-1f64-4ab0-8b69-3eb35d8a0261" released by "delete_snapshot" :: held 2.813s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Created reservations ['10ffa0bb-5547-4a4c-b601-64f39603a31b', '30f72416-c466-4181-a586-a914ee44e989', '9c1cfed5-4b71-45cc-b60d-bc5c4753983e', 'c08e84a0-3ffb-41be-8fd3-7a15e3307cad'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Delete snapshot completed successfully. Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3127a12b-7219-43dd-9e5a-7157eddb664d tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-ec4d4749-e835-4604-bce7-039baf58eb85-delete_snapshot" released by "delete_snapshot" :: held 2.970s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:04 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.524s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Deleted volume successfully. Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3267eccf-1192-4609-8577-b1e965982b99 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-0290f3da-c651-4ca8-b172-005b9487cd2c-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (e3f65aac-c374-4b80-9fb4-76261d8b0a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfdf9a4-0882-4e1b-bf79-747f72261bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfdf9a4-0882-4e1b-bf79-747f72261bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1319476464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a75261-a732-49d5-ba42-8df5479d0cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:05Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b49e97-51ed-4f1b-ab8b-ba78a09f0230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b49e97-51ed-4f1b-ab8b-ba78a09f0230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d285e7-28bf-4947-9a48-43de1b6d0d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d285e7-28bf-4947-9a48-43de1b6d0d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49a75261-a732-49d5-ba42-8df5479d0cfa', 'volume_name': 'volume-49a75261-a732-49d5-ba42-8df5479d0cfa', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b885abc-1ffb-4f0c-baed-3abcd35457f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b885abc-1ffb-4f0c-baed-3abcd35457f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11bcb4e-3de4-4f7b-bc11-6dfb7dd6a904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:04 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Volume 49a75261-a732-49d5-ba42-8df5479d0cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49a75261-a732-49d5-ba42-8df5479d0cfa', 'volume_size': 1} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1319476464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49a75261-a732-49d5-ba42-8df5479d0cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:05Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Creating volume 49a75261-a732-49d5-ba42-8df5479d0cfa {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:04 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:04 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa 1073741824 Apr 10 10:39:04 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Flow 'volume_create_manager' (daf6cdc6-b0d8-405a-b3ee-b42ec748960f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9360af9-7820-4e17-b29e-b7c15489ff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9360af9-7820-4e17-b29e-b7c15489ff72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-211392028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd0c314-09bd-4a21-9977-5750815d651f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44efd03c8b9c4eb78b2d8a7d9d35ff76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:05Z,use_quota=True,user_id='e89a29b8e49b41f39de9251205e064d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c34e68-c867-4fe4-98af-8955c0524274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c34e68-c867-4fe4-98af-8955c0524274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add45283-ab17-41fd-a2ca-6f781bb53a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add45283-ab17-41fd-a2ca-6f781bb53a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd0c314-09bd-4a21-9977-5750815d651f', 'volume_name': 'volume-bcd0c314-09bd-4a21-9977-5750815d651f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a52c9e-2fdd-4441-a53d-dd015d878a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a52c9e-2fdd-4441-a53d-dd015d878a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b183a2ef-9817-4663-ab4b-142515709107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:04 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Volume bcd0c314-09bd-4a21-9977-5750815d651f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd0c314-09bd-4a21-9977-5750815d651f', 'volume_size': 1} Apr 10 10:39:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:05 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa 1073741824" returned: 0 in 0.657s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:05 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa Apr 10 10:39:05 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:06 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa" returned: 0 in 0.638s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-211392028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd0c314-09bd-4a21-9977-5750815d651f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44efd03c8b9c4eb78b2d8a7d9d35ff76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:05Z,use_quota=True,user_id='e89a29b8e49b41f39de9251205e064d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Creating volume bcd0c314-09bd-4a21-9977-5750815d651f {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:06 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11bcb4e-3de4-4f7b-bc11-6dfb7dd6a904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49a75261-a732-49d5-ba42-8df5479d0cfa', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf4a4da-9c86-4604-8959-40db2601f5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:06 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f 1073741824 Apr 10 10:39:06 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Volume volume-49a75261-a732-49d5-ba42-8df5479d0cfa (49a75261-a732-49d5-ba42-8df5479d0cfa): created successfully Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf4a4da-9c86-4604-8959-40db2601f5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (e3f65aac-c374-4b80-9fb4-76261d8b0a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-079b25cd-2195-44d8-ac44-b0cbf4d6ebfa tempest-VolumesActionsTest-318027248 None] Created volume successfully. Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Flow 'volume_create_manager' (d0d12969-d9b4-4c28-8916-b35b2b4d339f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c032c5f-b940-45b0-8b3a-e785da896d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c032c5f-b940-45b0-8b3a-e785da896d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-45025180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31e9ee2-227c-4111-a857-16cea0ac305f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2690c0932d5c4d7a8994a1f067b77adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:06Z,use_quota=True,user_id='3e43ae6dcee640d08b556607286a638e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dac0f9-a115-4685-bc52-00bcd1a1bcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dac0f9-a115-4685-bc52-00bcd1a1bcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62520cf-27f3-49af-9072-55b6c76ca6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62520cf-27f3-49af-9072-55b6c76ca6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31e9ee2-227c-4111-a857-16cea0ac305f', 'volume_name': 'volume-e31e9ee2-227c-4111-a857-16cea0ac305f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a149efd-0867-458c-bdfd-e1d2af7f974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a149efd-0867-458c-bdfd-e1d2af7f974e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8e1b65-862a-4f97-ba61-06a1a362d2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Volume e31e9ee2-227c-4111-a857-16cea0ac305f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31e9ee2-227c-4111-a857-16cea0ac305f', 'volume_size': 1} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:06 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f 1073741824" returned: 0 in 0.585s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:06 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f Apr 10 10:39:06 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "cinder-49a75261-a732-49d5-ba42-8df5479d0cfa-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-49a75261-a732-49d5-ba42-8df5479d0cfa-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "cinder-quobyte-49a75261-a732-49d5-ba42-8df5479d0cfa" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-quobyte-49a75261-a732-49d5-ba42-8df5479d0cfa" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42b9071-ba2d-4830-b4b9-bf3936f8b100]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:07 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa Apr 10 10:39:07 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:07 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f" returned: 0 in 0.546s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.847s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-45025180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31e9ee2-227c-4111-a857-16cea0ac305f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2690c0932d5c4d7a8994a1f067b77adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:06Z,use_quota=True,user_id='3e43ae6dcee640d08b556607286a638e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Creating volume e31e9ee2-227c-4111-a857-16cea0ac305f {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:07 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b183a2ef-9817-4663-ab4b-142515709107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd0c314-09bd-4a21-9977-5750815d651f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:07 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f 1073741824 Apr 10 10:39:07 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf17a1ba-ba07-4c2f-86b2-c9f327da2dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:07 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Volume volume-bcd0c314-09bd-4a21-9977-5750815d651f (bcd0c314-09bd-4a21-9977-5750815d651f): created successfully Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf17a1ba-ba07-4c2f-86b2-c9f327da2dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Flow 'volume_create_manager' (daf6cdc6-b0d8-405a-b3ee-b42ec748960f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-32442c2a-ebfa-4493-b6cf-49678f6f46ce tempest-VolumesSnapshotTestJSON-1059589447 None] Created volume successfully. Apr 10 10:39:07 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa" returned: 0 in 0.594s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:07 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa Apr 10 10:39:07 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:07 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f 1073741824" returned: 0 in 0.667s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:08 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f Apr 10 10:39:08 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:08 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-49a75261-a732-49d5-ba42-8df5479d0cfa" returned: 0 in 0.580s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-quobyte-49a75261-a732-49d5-ba42-8df5479d0cfa" released by "delete_volume" :: held 1.214s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Created reservations ['fc8c88e0-9fea-4e26-bfe7-6acec0a0acae', '4d6427ee-557b-4e49-bdcd-4023c8f0feb2', '06f043ce-2d80-4cc6-9d48-2419987c5572', 'd9a5e1b9-56a0-499f-9815-34e53211b4f6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:08 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:08 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:08 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f" returned: 0 in 0.570s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.404s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8e1b65-862a-4f97-ba61-06a1a362d2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31e9ee2-227c-4111-a857-16cea0ac305f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f0722b-b8b9-4448-b998-96cba49d6383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] Creating offline snapshot f46a4350-f90c-4a12-8f9e-c11a008cc9c4 of volume bcd0c314-09bd-4a21-9977-5750815d651f {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:39:08 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Volume volume-e31e9ee2-227c-4111-a857-16cea0ac305f (e31e9ee2-227c-4111-a857-16cea0ac305f): created successfully Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f0722b-b8b9-4448-b998-96cba49d6383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Flow 'volume_create_manager' (d0d12969-d9b4-4c28-8916-b35b2b4d339f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[534b1443-44dd-438f-b144-d7f26a46f39b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-d296a503-ea0e-4f1f-8e2b-c67f30b6adab tempest-SnapshotDependencyTests-971595061 None] Created volume successfully. Apr 10 10:39:08 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f Apr 10 10:39:08 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:08 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.522s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Deleted volume successfully. Apr 10 10:39:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-00d7ad43-31f2-49cc-b1f0-a16d32dcfcf9 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-49a75261-a732-49d5-ba42-8df5479d0cfa-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:09 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f" returned: 0 in 0.655s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:09 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 1G Apr 10 10:39:09 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (939e2682-575a-481c-a99c-ba2a766f1d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9312079b-6abc-4524-9845-3e223ea74aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9312079b-6abc-4524-9845-3e223ea74aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-246591697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dab9daa-57f9-4093-a43e-c83d4d2d6b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:10Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0d9c07-e47d-4197-b86a-a6ec3717a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0d9c07-e47d-4197-b86a-a6ec3717a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0cf5b8-10e0-4511-a16d-905c3c51ec80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0cf5b8-10e0-4511-a16d-905c3c51ec80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dab9daa-57f9-4093-a43e-c83d4d2d6b90', 'volume_name': 'volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5737a1f-431a-40d0-8654-8279407dd782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5737a1f-431a-40d0-8654-8279407dd782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d274a98-af4f-4331-9995-85ba658e1a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Volume 8dab9daa-57f9-4093-a43e-c83d4d2d6b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90', 'volume_size': 1} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:10 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 1G" returned: 0 in 0.722s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcd0c314-09bd-4a21-9977-5750815d651f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:10 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcd0c314-09bd-4a21-9977-5750815d651f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 Apr 10 10:39:10 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:10 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcd0c314-09bd-4a21-9977-5750815d651f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4" returned: 0 in 0.536s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:10 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 is being set with open permissions: ugo+rw Apr 10 10:39:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:10 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 Apr 10 10:39:10 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:11 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4" returned: 0 in 0.498s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:11 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.info Apr 10 10:39:11 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:11 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.info" returned: 0 in 0.596s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:11 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.info is being set with open permissions: ugo+rw Apr 10 10:39:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:11 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.info Apr 10 10:39:11 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:12 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.info" returned: 0 in 0.544s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.654s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.533s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-246591697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dab9daa-57f9-4093-a43e-c83d4d2d6b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:10Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Creating volume 8dab9daa-57f9-4093-a43e-c83d4d2d6b90 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:12 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:12 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90 1073741824 Apr 10 10:39:12 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f9c8702c-c7e8-4c29-8a6d-c8decea88019 tempest-VolumesSnapshotTestJSON-1059589447 None] Create snapshot completed successfully Apr 10 10:39:12 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90 1073741824" returned: 0 in 0.618s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:12 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90 Apr 10 10:39:12 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:13 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90" returned: 0 in 0.478s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.509s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d274a98-af4f-4331-9995-85ba658e1a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd0167d-c029-4f62-a81d-5bd5e2b46607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] Creating offline snapshot f53443f9-0422-4eda-8abf-ba0c637e8b81 of volume e31e9ee2-227c-4111-a857-16cea0ac305f {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d0721b-e746-427e-a4e6-50eacfdff11e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:13 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Volume volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90 (8dab9daa-57f9-4093-a43e-c83d4d2d6b90): created successfully Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd0167d-c029-4f62-a81d-5bd5e2b46607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (939e2682-575a-481c-a99c-ba2a766f1d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:13 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7a561e79-084e-416e-9f67-4ad3a2ec065a tempest-VolumesActionsTest-318027248 None] Created volume successfully. Apr 10 10:39:13 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f Apr 10 10:39:13 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Flow 'volume_create_manager' (19f927e9-0604-46da-bb6d-30c365e2e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b14ba2-1ad8-4711-a178-18ccd9d7d776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b14ba2-1ad8-4711-a178-18ccd9d7d776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2090919568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd33344-37d7-43de-8f13-5ccf6a8c0e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44efd03c8b9c4eb78b2d8a7d9d35ff76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f46a4350-f90c-4a12-8f9e-c11a008cc9c4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:14Z,use_quota=True,user_id='e89a29b8e49b41f39de9251205e064d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1631f8f3-f0a6-455b-918f-d6e6fad8654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1631f8f3-f0a6-455b-918f-d6e6fad8654d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0e2fdb-7552-406e-a90f-bce2eca86cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0e2fdb-7552-406e-a90f-bce2eca86cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7cd33344-37d7-43de-8f13-5ccf6a8c0e3c', 'volume_name': 'volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c', 'volume_size': 2, 'snapshot_id': 'f46a4350-f90c-4a12-8f9e-c11a008cc9c4'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45327317-12dd-4443-ad15-eb85896e35ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45327317-12dd-4443-ad15-eb85896e35ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d832eb-775e-4e12-8deb-81173bfed395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:13 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Volume 7cd33344-37d7-43de-8f13-5ccf6a8c0e3c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c', 'volume_size': 2, 'snapshot_id': 'f46a4350-f90c-4a12-8f9e-c11a008cc9c4'} Apr 10 10:39:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "cinder-8dab9daa-57f9-4093-a43e-c83d4d2d6b90-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-8dab9daa-57f9-4093-a43e-c83d4d2d6b90-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "cinder-quobyte-8dab9daa-57f9-4093-a43e-c83d4d2d6b90" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-quobyte-8dab9daa-57f9-4093-a43e-c83d4d2d6b90" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b41abf2-1f8c-4b54-839e-d95758ba25b8]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:14 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f" returned: 0 in 0.675s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:14 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 1G Apr 10 10:39:14 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:14 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90 Apr 10 10:39:14 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:14 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90" returned: 0 in 0.569s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:14 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90 Apr 10 10:39:14 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:14 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 1G" returned: 0 in 0.582s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31e9ee2-227c-4111-a857-16cea0ac305f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:14 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31e9ee2-227c-4111-a857-16cea0ac305f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 Apr 10 10:39:14 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:15 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8dab9daa-57f9-4093-a43e-c83d4d2d6b90" returned: 0 in 0.486s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-quobyte-8dab9daa-57f9-4093-a43e-c83d4d2d6b90" released by "delete_volume" :: held 1.089s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Created reservations ['6e1c340e-9711-4e6d-ba93-a39156385714', '7f771118-5eb0-4705-b022-76b38b7c0774', '78538f72-edb7-4230-99c4-b86c8732db29', '9edf4466-333d-4759-bf9f-f2f24a3f99ee'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:15 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31e9ee2-227c-4111-a857-16cea0ac305f -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81" returned: 0 in 0.563s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:15 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 is being set with open permissions: ugo+rw Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:15 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 Apr 10 10:39:15 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:15 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:15 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:15 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81" returned: 0 in 0.483s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:15 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.481s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:15 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.info Apr 10 10:39:15 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Deleted volume successfully. Apr 10 10:39:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-02bffcc3-19d0-4891-88f5-a487a89dd952 tempest-VolumesActionsTest-1570800517 None] Lock "cinder-8dab9daa-57f9-4093-a43e-c83d4d2d6b90-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:16 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.info" returned: 0 in 0.514s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:16 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.info is being set with open permissions: ugo+rw Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:16 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.info Apr 10 10:39:16 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (beb7763a-2f37-4441-a58e-0ac74a46e8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdaff150-1bec-4f12-b3cc-7f3153a7b80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdaff150-1bec-4f12-b3cc-7f3153a7b80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1974696389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846a086a-e46b-4823-b82c-1b5898beb956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:17Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec484b80-7798-4bb6-904a-ea7154e2766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec484b80-7798-4bb6-904a-ea7154e2766f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0554d926-0d32-43fa-844f-4f8d81481b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0554d926-0d32-43fa-844f-4f8d81481b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846a086a-e46b-4823-b82c-1b5898beb956', 'volume_name': 'volume-846a086a-e46b-4823-b82c-1b5898beb956', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69b5da3-de4a-46a4-9603-0e1b0b089c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69b5da3-de4a-46a4-9603-0e1b0b089c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160d30fe-6836-496a-a809-4cb751908515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:16 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Volume 846a086a-e46b-4823-b82c-1b5898beb956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846a086a-e46b-4823-b82c-1b5898beb956', 'volume_size': 1} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:16 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.info" returned: 0 in 0.551s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.455s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.988s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-f46a4350-f90c-4a12-8f9e-c11a008cc9c4-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4920093b-b801-40ba-99de-614698ae9087 tempest-SnapshotDependencyTests-971595061 None] Create snapshot completed successfully Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-f46a4350-f90c-4a12-8f9e-c11a008cc9c4-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Creating volume 7cd33344-37d7-43de-8f13-5ccf6a8c0e3c from snapshot f46a4350-f90c-4a12-8f9e-c11a008cc9c4 {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] snapshot: f46a4350-f90c-4a12-8f9e-c11a008cc9c4, volume: 7cd33344-37d7-43de-8f13-5ccf6a8c0e3c, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad63ff-8d15-4b91-bfbb-f4a622a22f5c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:17 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 Apr 10 10:39:17 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:17 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Flow 'volume_create_manager' (f336f0c4-e0ec-481a-92d9-4870491b9df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb8d866-88a5-4501-9769-758f19e07035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4" returned: 0 in 0.645s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcd0c314-09bd-4a21-9977-5750815d651f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2a9bc-dbe6-4987-a7d9-5584c0468005]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb8d866-88a5-4501-9769-758f19e07035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56f9216-32e1-42f5-942d-2ab6b8b37a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2690c0932d5c4d7a8994a1f067b77adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f53443f9-0422-4eda-8abf-ba0c637e8b81,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:17Z,use_quota=True,user_id='3e43ae6dcee640d08b556607286a638e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6e760f-6861-49c7-982e-28470dd76d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6e760f-6861-49c7-982e-28470dd76d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f99d27-8dad-4ade-a730-a602328707e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f99d27-8dad-4ade-a730-a602328707e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd56f9216-32e1-42f5-942d-2ab6b8b37a3a', 'volume_name': 'volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a', 'volume_size': 1, 'snapshot_id': 'f53443f9-0422-4eda-8abf-ba0c637e8b81'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a339965-165b-49b0-9420-7f283050a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a339965-165b-49b0-9420-7f283050a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31c06b7-3245-4c2c-b2d5-80b4ebb5842f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:17 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Volume d56f9216-32e1-42f5-942d-2ab6b8b37a3a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a', 'volume_size': 1, 'snapshot_id': 'f53443f9-0422-4eda-8abf-ba0c637e8b81'} Apr 10 10:39:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:17 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f Apr 10 10:39:17 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:18 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f" returned: 0 in 0.576s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:18 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:39:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:18 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c Apr 10 10:39:18 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:20 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" returned: 0 in 2.452s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:20 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[003cf7e2-f9f0-4a7c-b154-f4d1ca1ba49b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:20 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f Apr 10 10:39:20 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:21 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f" returned: 0 in 0.835s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:21 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f, size 1024.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:39:21 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Converted 1024.00 MB image at 417.45 MB/s Apr 10 10:39:21 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c is being set with open permissions: ugo+rw Apr 10 10:39:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:21 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c Apr 10 10:39:21 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:22 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" returned: 0 in 0.572s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" released by "_copy_volume_from_snapshot" :: held 5.159s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-f46a4350-f90c-4a12-8f9e-c11a008cc9c4-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" released by "_create_volume_from_snapshot" :: held 5.180s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.216s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.435s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1974696389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846a086a-e46b-4823-b82c-1b5898beb956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='199683799e22470fbc0d014250f765c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:17Z,use_quota=True,user_id='83312cb52d1e485da87666b1d594b283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Creating volume 846a086a-e46b-4823-b82c-1b5898beb956 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:22 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:22 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956 1073741824 Apr 10 10:39:22 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d832eb-775e-4e12-8deb-81173bfed395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c', 'volume_size': 2, 'snapshot_id': 'f46a4350-f90c-4a12-8f9e-c11a008cc9c4'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ffd2c3-2185-4199-b1c1-b7664ebd069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Volume volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c (7cd33344-37d7-43de-8f13-5ccf6a8c0e3c): created successfully Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ffd2c3-2185-4199-b1c1-b7664ebd069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Flow 'volume_create_manager' (19f927e9-0604-46da-bb6d-30c365e2e247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:22 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f003f356-edb4-48ff-83b8-6180dd11010f tempest-VolumesSnapshotTestJSON-1059589447 None] Created volume successfully. Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e632980-abd6-46c8-a08c-558ff048b957]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:22 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c Apr 10 10:39:22 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:22 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956 1073741824" returned: 0 in 0.583s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:22 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956 Apr 10 10:39:22 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:23 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" returned: 0 in 0.572s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:23 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c Apr 10 10:39:23 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:23 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956" returned: 0 in 0.477s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.521s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "cinder-quobyte-f53443f9-0422-4eda-8abf-ba0c637e8b81-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160d30fe-6836-496a-a809-4cb751908515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846a086a-e46b-4823-b82c-1b5898beb956', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff96fe18-59f8-4668-9ee5-e5d469977edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-f53443f9-0422-4eda-8abf-ba0c637e8b81-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Creating volume d56f9216-32e1-42f5-942d-2ab6b8b37a3a from snapshot f53443f9-0422-4eda-8abf-ba0c637e8b81 {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "cinder-quobyte-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:23 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Volume volume-846a086a-e46b-4823-b82c-1b5898beb956 (846a086a-e46b-4823-b82c-1b5898beb956): created successfully Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff96fe18-59f8-4668-9ee5-e5d469977edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Flow 'volume_create_manager' (beb7763a-2f37-4441-a58e-0ac74a46e8c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] snapshot: f53443f9-0422-4eda-8abf-ba0c637e8b81, volume: d56f9216-32e1-42f5-942d-2ab6b8b37a3a, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:39:23 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4e62f3e7-f5f6-4ada-9126-eba1ba1c2c59 tempest-VolumesActionsTest-318027248 None] Created volume successfully. Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[156f61b8-ae1a-4063-891b-3c34ab99d7b0]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:23 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 Apr 10 10:39:23 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:23 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" returned: 0 in 0.500s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c" released by "delete_volume" :: held 1.101s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Created reservations ['04e8c8e5-a0bf-4223-8435-26d62c495348', '173535eb-1c22-4e00-92c8-a0dbf34cb46d', '16ec63cc-0c22-49af-8960-9ffce21dd91e', 'b3cae884-11c2-435e-8806-563712858286'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:23 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:23 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:23 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81" returned: 0 in 0.579s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e31e9ee2-227c-4111-a857-16cea0ac305f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e39a4f-d78f-41f0-b9ac-95b81b22353e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:23 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f Apr 10 10:39:23 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:24 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.477s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Deleted volume successfully. Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2b6ba1c7-fc9a-41d0-ba22-e3236d92a0f1 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-7cd33344-37d7-43de-8f13-5ccf6a8c0e3c-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:24 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f" returned: 0 in 0.549s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:24 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a Apr 10 10:39:24 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-f46a4350-f90c-4a12-8f9e-c11a008cc9c4-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Acquiring lock "cinder-846a086a-e46b-4823-b82c-1b5898beb956-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-f46a4350-f90c-4a12-8f9e-c11a008cc9c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-bcd0c314-09bd-4a21-9977-5750815d651f" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Lock "cinder-846a086a-e46b-4823-b82c-1b5898beb956-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-bcd0c314-09bd-4a21-9977-5750815d651f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-f46a4350-f90c-4a12-8f9e-c11a008cc9c4" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-f46a4350-f90c-4a12-8f9e-c11a008cc9c4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Deleting offline snapshot f46a4350-f90c-4a12-8f9e-c11a008cc9c4 of volume bcd0c314-09bd-4a21-9977-5750815d651f {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] snapshot_file for this snap is: volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa888fad-4dc3-47cb-9d78-aa37bd7473f8]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Acquiring lock "cinder-quobyte-846a086a-e46b-4823-b82c-1b5898beb956" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Lock "cinder-quobyte-846a086a-e46b-4823-b82c-1b5898beb956" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8432545-2d95-46df-bef5-c2a36335bcc1]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:24 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 Apr 10 10:39:24 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:24 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956 Apr 10 10:39:24 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:25 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956" returned: 0 in 1.043s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:25 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956 Apr 10 10:39:25 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:26 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4" returned: 0 in 1.291s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcd0c314-09bd-4a21-9977-5750815d651f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b439fe-9996-42c6-8c07-018f75bcc586]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:26 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f Apr 10 10:39:26 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:26 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:26 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" returned: 0 in 2.475s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f" returned: 0 in 0.827s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a97a16-5366-45de-a5ee-17a0eedfeab4]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:26 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 Apr 10 10:39:26 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:26 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f Apr 10 10:39:26 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:27 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-846a086a-e46b-4823-b82c-1b5898beb956" returned: 0 in 1.179s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Lock "cinder-quobyte-846a086a-e46b-4823-b82c-1b5898beb956" released by "delete_volume" :: held 2.242s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Created reservations ['9c703c5a-9b66-4711-b82f-a4f03fe666d2', '59189d9b-337d-4268-baa8-20076aaa00a4', 'fd32fa3f-7724-4cd7-a980-71ccd84fdc89', '52699bbe-b582-4d09-a84b-ca7a1a7463b1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:27 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:27 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:27 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4" returned: 0 in 0.596s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:27 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4 Apr 10 10:39:27 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:27 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f" returned: 0 in 0.654s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f, size 1024.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:39:27 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Converted 1024.00 MB image at 413.46 MB/s Apr 10 10:39:27 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a is being set with open permissions: ugo+rw Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:27 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.468s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:27 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Deleted volume successfully. Apr 10 10:39:27 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a Apr 10 10:39:27 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-4e7cf958-58eb-482c-b270-3433ba211069 tempest-VolumesActionsTest-318027248 None] Lock "cinder-846a086a-e46b-4823-b82c-1b5898beb956-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:27 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f.f46a4350-f90c-4a12-8f9e-c11a008cc9c4" returned: 0 in 0.479s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-f46a4350-f90c-4a12-8f9e-c11a008cc9c4" released by "_delete_snapshot" :: held 3.260s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-bcd0c314-09bd-4a21-9977-5750815d651f" released by "delete_snapshot" :: held 3.280s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Created reservations ['0476db0e-b72e-4de1-98c9-d32649e6207f', '1d8d0406-7bac-4e2f-abc1-c5e0cbc212ff', '29bef8d9-6e5e-4629-8489-74377315d6b1', 'b6cedec1-784e-4eee-8efd-1fd37035a121'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:28 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" returned: 0 in 0.521s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" released by "_copy_volume_from_snapshot" :: held 4.864s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-f53443f9-0422-4eda-8abf-ba0c637e8b81-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" released by "_create_volume_from_snapshot" :: held 4.903s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.933s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Delete snapshot completed successfully. Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-1e2135f0-3d39-4061-84b3-8e7d67b94009 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-f46a4350-f90c-4a12-8f9e-c11a008cc9c4-delete_snapshot" released by "delete_snapshot" :: held 3.416s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31c06b7-3245-4c2c-b2d5-80b4ebb5842f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a', 'volume_size': 1, 'snapshot_id': 'f53443f9-0422-4eda-8abf-ba0c637e8b81'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab80274e-854a-465c-bd20-1cb8827a9c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:28 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Volume volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a (d56f9216-32e1-42f5-942d-2ab6b8b37a3a): created successfully Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab80274e-854a-465c-bd20-1cb8827a9c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Flow 'volume_create_manager' (f336f0c4-e0ec-481a-92d9-4870491b9df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2e04575a-dff3-481c-92b2-a5478360725f tempest-SnapshotDependencyTests-971595061 None] Created volume successfully. Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-bcd0c314-09bd-4a21-9977-5750815d651f-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-bcd0c314-09bd-4a21-9977-5750815d651f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-bcd0c314-09bd-4a21-9977-5750815d651f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-bcd0c314-09bd-4a21-9977-5750815d651f" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[23681931-4b3a-4500-bed6-32e979384d91]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:29 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f Apr 10 10:39:29 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "cinder-f53443f9-0422-4eda-8abf-ba0c637e8b81-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-f53443f9-0422-4eda-8abf-ba0c637e8b81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "cinder-quobyte-e31e9ee2-227c-4111-a857-16cea0ac305f" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-e31e9ee2-227c-4111-a857-16cea0ac305f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "cinder-quobyte-f53443f9-0422-4eda-8abf-ba0c637e8b81" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-f53443f9-0422-4eda-8abf-ba0c637e8b81" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Deleting offline snapshot f53443f9-0422-4eda-8abf-ba0c637e8b81 of volume e31e9ee2-227c-4111-a857-16cea0ac305f {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] snapshot_file for this snap is: volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4568506c-29ac-4e2b-8773-05f9bb2d440b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:29 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 Apr 10 10:39:29 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:29 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f" returned: 0 in 0.577s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:29 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f Apr 10 10:39:29 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:29 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81" returned: 0 in 0.544s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e31e9ee2-227c-4111-a857-16cea0ac305f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1f3573-b269-4ec8-98d0-3a5fb9cb0395]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:30 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f Apr 10 10:39:30 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:30 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-bcd0c314-09bd-4a21-9977-5750815d651f" returned: 0 in 0.530s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-bcd0c314-09bd-4a21-9977-5750815d651f" released by "delete_volume" :: held 1.142s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Created reservations ['96034650-1d7d-4379-9dde-f333c2f043a7', '7fd9f7cc-9472-4bdc-b10e-55ab4b8ceced', '543781c8-0b59-406d-b6b3-937267849a1d', '666fbca6-64ba-4d65-b3fc-4740aed8cd7c'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:30 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:30 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:30 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f" returned: 0 in 0.756s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:30 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 Apr 10 10:39:30 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:30 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.591s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Deleted volume successfully. Apr 10 10:39:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b4ed0c-b0b4-4389-be95-9828b612d2e5 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-bcd0c314-09bd-4a21-9977-5750815d651f-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:31 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81" returned: 0 in 0.609s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:31 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81 Apr 10 10:39:31 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Flow 'volume_create_manager' (ced4b3ec-81fa-409a-8a00-1a889ec8a35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c94b84-9009-4ed8-b67a-2d827309053d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c94b84-9009-4ed8-b67a-2d827309053d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-762283847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d60a69-dfd6-4948-9a9e-33705068f507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44efd03c8b9c4eb78b2d8a7d9d35ff76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:32Z,use_quota=True,user_id='e89a29b8e49b41f39de9251205e064d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20b708f-6c41-4f61-9712-53d4fec842a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20b708f-6c41-4f61-9712-53d4fec842a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdfe1a5-5496-40cc-aa57-e4e577cc1348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdfe1a5-5496-40cc-aa57-e4e577cc1348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d60a69-dfd6-4948-9a9e-33705068f507', 'volume_name': 'volume-82d60a69-dfd6-4948-9a9e-33705068f507', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6a20ec-35b6-426b-b58d-27e579e1413a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6a20ec-35b6-426b-b58d-27e579e1413a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f44f6e-cf51-4cfd-aea7-951948ba241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:31 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Volume 82d60a69-dfd6-4948-9a9e-33705068f507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d60a69-dfd6-4948-9a9e-33705068f507', 'volume_size': 1} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-762283847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d60a69-dfd6-4948-9a9e-33705068f507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44efd03c8b9c4eb78b2d8a7d9d35ff76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:32Z,use_quota=True,user_id='e89a29b8e49b41f39de9251205e064d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Creating volume 82d60a69-dfd6-4948-9a9e-33705068f507 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:31 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:31 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 1073741824 Apr 10 10:39:31 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:31 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f.f53443f9-0422-4eda-8abf-ba0c637e8b81" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-f53443f9-0422-4eda-8abf-ba0c637e8b81" released by "_delete_snapshot" :: held 2.488s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-e31e9ee2-227c-4111-a857-16cea0ac305f" released by "delete_snapshot" :: held 2.501s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Created reservations ['3f0058ee-d312-45c8-8fe0-b9304112d07b', '116b1f13-6d83-4d8f-b54a-1e2ce9a62c7b', '9c7856e1-3562-4d8c-b81e-f9e0594171b3', 'a68c0604-b11a-4971-8523-b8cb83c3399f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Delete snapshot completed successfully. Apr 10 10:39:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-aecd64c2-380a-4f55-a354-47914de86f87 tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-f53443f9-0422-4eda-8abf-ba0c637e8b81-delete_snapshot" released by "delete_snapshot" :: held 2.600s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:32 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 1073741824" returned: 0 in 0.606s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:32 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 Apr 10 10:39:32 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "cinder-e31e9ee2-227c-4111-a857-16cea0ac305f-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-e31e9ee2-227c-4111-a857-16cea0ac305f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "cinder-quobyte-e31e9ee2-227c-4111-a857-16cea0ac305f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-e31e9ee2-227c-4111-a857-16cea0ac305f" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed119b6-ed8c-44af-b3de-777b23409653]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:32 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f Apr 10 10:39:32 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:32 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507" returned: 0 in 0.550s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f44f6e-cf51-4cfd-aea7-951948ba241c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d60a69-dfd6-4948-9a9e-33705068f507', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0befbcaa-2cc5-4c98-9627-c30a45f9c8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:32 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Volume volume-82d60a69-dfd6-4948-9a9e-33705068f507 (82d60a69-dfd6-4948-9a9e-33705068f507): created successfully Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0befbcaa-2cc5-4c98-9627-c30a45f9c8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:32 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Flow 'volume_create_manager' (ced4b3ec-81fa-409a-8a00-1a889ec8a35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:32 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9d9ae20b-366e-4ad6-9416-822133f6b282 tempest-VolumesSnapshotTestJSON-1059589447 None] Created volume successfully. Apr 10 10:39:33 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f" returned: 0 in 0.583s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:33 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f Apr 10 10:39:33 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:33 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e31e9ee2-227c-4111-a857-16cea0ac305f" returned: 0 in 0.491s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-e31e9ee2-227c-4111-a857-16cea0ac305f" released by "delete_volume" :: held 1.131s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Created reservations ['549cfe4c-b486-4d32-96f5-7a89a2be354f', '7a540370-6d62-4a33-afd4-c56ef210e9d5', 'bb4791b9-0ca8-4a7e-9a40-52aeb0256c2e', '2396bf3b-4281-469f-ab4b-c05529b371b4'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:33 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:33 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] Creating offline snapshot 703f2806-7726-4a0f-86d0-9444170aa792 of volume 82d60a69-dfd6-4948-9a9e-33705068f507 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a4088e-6667-4fe3-be6a-0de678a51a14]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:33 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 Apr 10 10:39:33 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:34 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.506s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:34 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:34 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Deleted volume successfully. Apr 10 10:39:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-bcb7256a-f859-40ac-97ba-62f7f3d576fa tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-e31e9ee2-227c-4111-a857-16cea0ac305f-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:34 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507" returned: 0 in 0.631s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:34 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 1G Apr 10 10:39:34 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "cinder-d56f9216-32e1-42f5-942d-2ab6b8b37a3a-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-d56f9216-32e1-42f5-942d-2ab6b8b37a3a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "cinder-quobyte-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d628100b-0dfd-4abe-b97f-2d1c12325b87]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:34 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a Apr 10 10:39:34 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:35 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 1G" returned: 0 in 0.678s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d60a69-dfd6-4948-9a9e-33705068f507 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:35 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d60a69-dfd6-4948-9a9e-33705068f507 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 Apr 10 10:39:35 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:35 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" returned: 0 in 0.624s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:35 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a Apr 10 10:39:35 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:35 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82d60a69-dfd6-4948-9a9e-33705068f507 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:35 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 is being set with open permissions: ugo+rw Apr 10 10:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:35 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 Apr 10 10:39:35 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:35 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" returned: 0 in 0.588s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:35 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-quobyte-d56f9216-32e1-42f5-942d-2ab6b8b37a3a" released by "delete_volume" :: held 1.237s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Created reservations ['3ecdd06d-a06e-4556-9dfc-faa5e7afae39', '1179a7a0-f371-49d6-bef8-ee39bc7124e8', '81c77524-4099-45cd-9592-e665b5caee96', '272d7cc7-cae0-4bff-a170-5f6af4b34c05'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:36 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:36 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:36 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792" returned: 0 in 0.549s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:36 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.info Apr 10 10:39:36 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:36 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.563s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:36 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Deleted volume successfully. Apr 10 10:39:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-5af0af38-8b3a-4689-be4b-016e83028f23 tempest-SnapshotDependencyTests-971595061 None] Lock "cinder-d56f9216-32e1-42f5-942d-2ab6b8b37a3a-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:37 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.info" returned: 0 in 0.629s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:37 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.info is being set with open permissions: ugo+rw Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:37 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.info Apr 10 10:39:37 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:37 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.info" returned: 0 in 0.636s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.859s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cb420b75-d592-46db-8e5c-964a717e85d5 tempest-VolumesSnapshotTestJSON-1059589447 None] Create snapshot completed successfully Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Flow 'volume_create_manager' (08df8d1d-afbe-4cb7-8397-f2480fa51e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d947206-1c66-4fce-8b56-7606659aea00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d947206-1c66-4fce-8b56-7606659aea00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-959358904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6c9888-3b21-4fec-9a54-3577fe0287df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1810aff56bb4f6494d0540b0bed2883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:38Z,use_quota=True,user_id='0fe75ba0f465400694f68a67b63808fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8aad00a-1f3e-48b6-94a5-b8bed3f39b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8aad00a-1f3e-48b6-94a5-b8bed3f39b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89aff597-b3ab-4c7a-b350-6b4835122815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89aff597-b3ab-4c7a-b350-6b4835122815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f6c9888-3b21-4fec-9a54-3577fe0287df', 'volume_name': 'volume-7f6c9888-3b21-4fec-9a54-3577fe0287df', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce97ed1c-635a-4d52-a11e-1f34613f09be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce97ed1c-635a-4d52-a11e-1f34613f09be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d26f38-cf4e-4d48-9ce5-b1814b5de6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:37 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Volume 7f6c9888-3b21-4fec-9a54-3577fe0287df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f6c9888-3b21-4fec-9a54-3577fe0287df', 'volume_size': 1} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-959358904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6c9888-3b21-4fec-9a54-3577fe0287df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1810aff56bb4f6494d0540b0bed2883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:38Z,use_quota=True,user_id='0fe75ba0f465400694f68a67b63808fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Creating volume 7f6c9888-3b21-4fec-9a54-3577fe0287df {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:38 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:38 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df 1073741824 Apr 10 10:39:38 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Flow 'volume_create_manager' (91dbf0b1-eee6-4267-a21e-77f0ac02e727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecc9a10-a0bb-4348-863f-9880eb2a6a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecc9a10-a0bb-4348-863f-9880eb2a6a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-842753671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221f4e9c-546a-4d67-ac01-ff9e35208669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44efd03c8b9c4eb78b2d8a7d9d35ff76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=703f2806-7726-4a0f-86d0-9444170aa792,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:38Z,use_quota=True,user_id='e89a29b8e49b41f39de9251205e064d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d428711f-0e33-4c36-9625-9753f4947edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d428711f-0e33-4c36-9625-9753f4947edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3803a9de-fd56-40e4-9b78-58437f211e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3803a9de-fd56-40e4-9b78-58437f211e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '221f4e9c-546a-4d67-ac01-ff9e35208669', 'volume_name': 'volume-221f4e9c-546a-4d67-ac01-ff9e35208669', 'volume_size': 1, 'snapshot_id': '703f2806-7726-4a0f-86d0-9444170aa792'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7aae06b-19e9-4f50-884c-937b51cee951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7aae06b-19e9-4f50-884c-937b51cee951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c929c5-10b3-42be-971e-9caf9874e15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:38 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Volume 221f4e9c-546a-4d67-ac01-ff9e35208669: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-221f4e9c-546a-4d67-ac01-ff9e35208669', 'volume_size': 1, 'snapshot_id': '703f2806-7726-4a0f-86d0-9444170aa792'} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:38 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df 1073741824" returned: 0 in 0.670s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:38 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df Apr 10 10:39:38 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:39 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df" returned: 0 in 0.514s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.768s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-703f2806-7726-4a0f-86d0-9444170aa792-221f4e9c-546a-4d67-ac01-ff9e35208669" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d26f38-cf4e-4d48-9ce5-b1814b5de6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6c9888-3b21-4fec-9a54-3577fe0287df', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e91322-edda-42a8-952b-27973980f4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-703f2806-7726-4a0f-86d0-9444170aa792-221f4e9c-546a-4d67-ac01-ff9e35208669" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Creating volume 221f4e9c-546a-4d67-ac01-ff9e35208669 from snapshot 703f2806-7726-4a0f-86d0-9444170aa792 {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-221f4e9c-546a-4d67-ac01-ff9e35208669" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Volume volume-7f6c9888-3b21-4fec-9a54-3577fe0287df (7f6c9888-3b21-4fec-9a54-3577fe0287df): created successfully Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e91322-edda-42a8-952b-27973980f4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Flow 'volume_create_manager' (08df8d1d-afbe-4cb7-8397-f2480fa51e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-221f4e9c-546a-4d67-ac01-ff9e35208669" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] snapshot: 703f2806-7726-4a0f-86d0-9444170aa792, volume: 221f4e9c-546a-4d67-ac01-ff9e35208669, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:39:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8035e23b-d7ed-461f-9aba-56c1dce8c92b tempest-VolumesListAdminTestJSON-450267209 None] Created volume successfully. Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2bfef4-9bf7-496b-b046-1087ea23a26e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:39 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 Apr 10 10:39:39 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:39 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792" returned: 0 in 0.625s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d60a69-dfd6-4948-9a9e-33705068f507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb71f60-a76d-48a4-bc17-211aff7d7dea]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:40 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 Apr 10 10:39:40 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Flow 'volume_create_manager' (4e38461d-d9da-4493-92d0-34fc332e5503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd3d4dc-6df5-4ba5-876e-b16e5fa6c0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd3d4dc-6df5-4ba5-876e-b16e5fa6c0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1670960528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e47e679-7d32-413a-9d96-db0484d6b5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1810aff56bb4f6494d0540b0bed2883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:40Z,use_quota=True,user_id='0fe75ba0f465400694f68a67b63808fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b27d67-1153-4f83-b7d2-5798d0e66ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b27d67-1153-4f83-b7d2-5798d0e66ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b668d215-6a0e-4210-800f-d6ddc390add2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b668d215-6a0e-4210-800f-d6ddc390add2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e47e679-7d32-413a-9d96-db0484d6b5fd', 'volume_name': 'volume-4e47e679-7d32-413a-9d96-db0484d6b5fd', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8414d9-b159-44a2-aebf-f934c132a259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8414d9-b159-44a2-aebf-f934c132a259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c102fc0-7620-4f24-ab4d-7147643f86fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Volume 4e47e679-7d32-413a-9d96-db0484d6b5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e47e679-7d32-413a-9d96-db0484d6b5fd', 'volume_size': 1} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:40 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507" returned: 0 in 0.722s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:39:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:40 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669 Apr 10 10:39:40 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:43 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669" returned: 0 in 2.699s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:43 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca0b5f0-17a8-4a69-8551-965984ec2236]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:43 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 Apr 10 10:39:43 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:44 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507" returned: 0 in 0.840s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507, size 1024.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:39:44 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Converted 1024.00 MB image at 379.11 MB/s Apr 10 10:39:44 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669 is being set with open permissions: ugo+rw Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:44 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669 Apr 10 10:39:44 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:44 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669" returned: 0 in 0.615s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-221f4e9c-546a-4d67-ac01-ff9e35208669" released by "_copy_volume_from_snapshot" :: held 5.570s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-703f2806-7726-4a0f-86d0-9444170aa792-221f4e9c-546a-4d67-ac01-ff9e35208669" released by "_create_volume_from_snapshot" :: held 5.605s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.629s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.309s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1670960528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e47e679-7d32-413a-9d96-db0484d6b5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1810aff56bb4f6494d0540b0bed2883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:40Z,use_quota=True,user_id='0fe75ba0f465400694f68a67b63808fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Creating volume 4e47e679-7d32-413a-9d96-db0484d6b5fd {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:44 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:44 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd 1073741824 Apr 10 10:39:44 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c929c5-10b3-42be-971e-9caf9874e15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-221f4e9c-546a-4d67-ac01-ff9e35208669', 'volume_size': 1, 'snapshot_id': '703f2806-7726-4a0f-86d0-9444170aa792'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23a5f49-8477-4b2b-b2df-ee275f32ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Volume volume-221f4e9c-546a-4d67-ac01-ff9e35208669 (221f4e9c-546a-4d67-ac01-ff9e35208669): created successfully Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23a5f49-8477-4b2b-b2df-ee275f32ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Flow 'volume_create_manager' (91dbf0b1-eee6-4267-a21e-77f0ac02e727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cc0a5f42-8fce-4027-89dc-e984b0536a41 tempest-VolumesSnapshotTestJSON-1059589447 None] Created volume successfully. Apr 10 10:39:45 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd 1073741824" returned: 0 in 0.674s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:45 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd Apr 10 10:39:45 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:45 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-221f4e9c-546a-4d67-ac01-ff9e35208669-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-221f4e9c-546a-4d67-ac01-ff9e35208669-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-221f4e9c-546a-4d67-ac01-ff9e35208669" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-221f4e9c-546a-4d67-ac01-ff9e35208669" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f728b6-f42a-43a1-8b30-023c1446a174]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:46 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd" returned: 0 in 0.591s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c102fc0-7620-4f24-ab4d-7147643f86fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e47e679-7d32-413a-9d96-db0484d6b5fd', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0774a0-b634-437d-912e-bea813a5ed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Volume volume-4e47e679-7d32-413a-9d96-db0484d6b5fd (4e47e679-7d32-413a-9d96-db0484d6b5fd): created successfully Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0774a0-b634-437d-912e-bea813a5ed50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Flow 'volume_create_manager' (4e38461d-d9da-4493-92d0-34fc332e5503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bbecacd1-f8f3-4041-a476-4a8070824c68 tempest-VolumesListAdminTestJSON-450267209 None] Created volume successfully. Apr 10 10:39:46 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669 Apr 10 10:39:46 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:46 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669" returned: 0 in 0.638s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:46 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669 Apr 10 10:39:46 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:47 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-221f4e9c-546a-4d67-ac01-ff9e35208669" returned: 0 in 0.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-221f4e9c-546a-4d67-ac01-ff9e35208669" released by "delete_volume" :: held 1.239s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Created reservations ['fa40bfb6-2fcc-4a5d-ad6d-7dbb121d158d', '5e350e49-da42-4ac2-bd59-80e201158c1e', 'af976158-ac63-40ac-932e-1ad7b82af466', '91ebe4d9-17e9-4e9f-b7cc-74688064f81c'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Flow 'volume_create_manager' (61814a87-23ba-4fdd-8f97-7ef9990ad818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9736ab-ae2c-4190-9e08-0ad02533b432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9736ab-ae2c-4190-9e08-0ad02533b432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1585790354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05f4ad2-12b9-4950-b8c5-7ccea3669e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1810aff56bb4f6494d0540b0bed2883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:47Z,use_quota=True,user_id='0fe75ba0f465400694f68a67b63808fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00108f10-e1b0-4a46-83f0-cf26c8798e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00108f10-e1b0-4a46-83f0-cf26c8798e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6431012b-5847-4908-939f-05eaf23d2ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6431012b-5847-4908-939f-05eaf23d2ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05f4ad2-12b9-4950-b8c5-7ccea3669e08', 'volume_name': 'volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509e8b67-2d2f-45c2-8a47-744b6e33e156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509e8b67-2d2f-45c2-8a47-744b6e33e156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a919f003-87da-4219-aa8a-f8aef7a8402b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:47 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Volume a05f4ad2-12b9-4950-b8c5-7ccea3669e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08', 'volume_size': 1} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1585790354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05f4ad2-12b9-4950-b8c5-7ccea3669e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1810aff56bb4f6494d0540b0bed2883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:47Z,use_quota=True,user_id='0fe75ba0f465400694f68a67b63808fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Creating volume a05f4ad2-12b9-4950-b8c5-7ccea3669e08 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:47 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:47 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08 1073741824 Apr 10 10:39:47 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:47 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:47 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:48 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.486s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Deleted volume successfully. Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-81e9b82f-2dad-4cd9-ad74-67bcd4b7ea4b tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-221f4e9c-546a-4d67-ac01-ff9e35208669-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:48 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08 1073741824" returned: 0 in 0.543s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:48 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08 Apr 10 10:39:48 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-703f2806-7726-4a0f-86d0-9444170aa792-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-703f2806-7726-4a0f-86d0-9444170aa792-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-82d60a69-dfd6-4948-9a9e-33705068f507" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-82d60a69-dfd6-4948-9a9e-33705068f507" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-703f2806-7726-4a0f-86d0-9444170aa792" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-703f2806-7726-4a0f-86d0-9444170aa792" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Deleting offline snapshot 703f2806-7726-4a0f-86d0-9444170aa792 of volume 82d60a69-dfd6-4948-9a9e-33705068f507 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] snapshot_file for this snap is: volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6901e9aa-5ed9-44d6-96bc-53257e5c170e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:48 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 Apr 10 10:39:48 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:48 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08" returned: 0 in 0.518s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a919f003-87da-4219-aa8a-f8aef7a8402b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9b64e6-f0db-4f70-ab14-262ad8d4cb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:48 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Volume volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08 (a05f4ad2-12b9-4950-b8c5-7ccea3669e08): created successfully Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9b64e6-f0db-4f70-ab14-262ad8d4cb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Flow 'volume_create_manager' (61814a87-23ba-4fdd-8f97-7ef9990ad818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f4c272c3-f224-41c9-93a8-9bc7a26e1b3a tempest-VolumesListAdminTestJSON-450267209 None] Created volume successfully. Apr 10 10:39:48 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792" returned: 0 in 0.544s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82d60a69-dfd6-4948-9a9e-33705068f507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abfaac4-7e52-45d7-bdb1-6ec2fdd2efa6]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:48 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 Apr 10 10:39:48 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:49 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507" returned: 0 in 0.576s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:49 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 Apr 10 10:39:49 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:50 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792" returned: 0 in 0.664s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:50 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792 Apr 10 10:39:50 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Flow 'volume_create_manager' (d63116a7-e900-491f-8e6e-0508dfe9c470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe79aae-97b6-4943-b270-2b188db01518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe79aae-97b6-4943-b270-2b188db01518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5096e0a4-82c7-463c-bc17-d8a637efe34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86df7ba9ff074141972617a6ee924b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:50Z,use_quota=True,user_id='04feee7b9aa24bd0be8484016c6de80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b126092-1975-4448-ace0-1ae7ae0e0f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b126092-1975-4448-ace0-1ae7ae0e0f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536e68a2-95e8-41e9-a319-5bfb38077491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536e68a2-95e8-41e9-a319-5bfb38077491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5096e0a4-82c7-463c-bc17-d8a637efe34d', 'volume_name': 'volume-5096e0a4-82c7-463c-bc17-d8a637efe34d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adef6332-2ed7-421f-8ced-b0282159df6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adef6332-2ed7-421f-8ced-b0282159df6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29e8c07-8a1c-4a57-ad40-6fb98515538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:50 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Volume 5096e0a4-82c7-463c-bc17-d8a637efe34d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5096e0a4-82c7-463c-bc17-d8a637efe34d', 'volume_size': 1} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5096e0a4-82c7-463c-bc17-d8a637efe34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86df7ba9ff074141972617a6ee924b14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:50Z,use_quota=True,user_id='04feee7b9aa24bd0be8484016c6de80d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Creating volume 5096e0a4-82c7-463c-bc17-d8a637efe34d {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:50 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:50 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d 1073741824 Apr 10 10:39:50 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:50 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507.703f2806-7726-4a0f-86d0-9444170aa792" returned: 0 in 0.553s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-703f2806-7726-4a0f-86d0-9444170aa792" released by "_delete_snapshot" :: held 2.408s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-82d60a69-dfd6-4948-9a9e-33705068f507" released by "delete_snapshot" :: held 2.423s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Created reservations ['5debbbdf-c0ea-43a3-8056-8178993e9829', '4c202045-b143-4b15-bf6c-32a9a6e0a494', 'c7e7c539-2f91-4c40-a0f2-689bac4b8265', '82c99c01-5ad9-4bc0-aed3-481acafb8857'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Delete snapshot completed successfully. Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29f2dc2b-af2b-485c-b3ea-ca103e8c93c7 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-703f2806-7726-4a0f-86d0-9444170aa792-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:50 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d 1073741824" returned: 0 in 0.627s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:50 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d Apr 10 10:39:50 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:51 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d" returned: 0 in 0.494s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29e8c07-8a1c-4a57-ad40-6fb98515538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5096e0a4-82c7-463c-bc17-d8a637efe34d', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1a0e53-4dd9-4de8-a235-ac68836ad03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:51 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Volume volume-5096e0a4-82c7-463c-bc17-d8a637efe34d (5096e0a4-82c7-463c-bc17-d8a637efe34d): created successfully Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1a0e53-4dd9-4de8-a235-ac68836ad03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Flow 'volume_create_manager' (d63116a7-e900-491f-8e6e-0508dfe9c470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-82d60a69-dfd6-4948-9a9e-33705068f507-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:51 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-56bc440e-7ceb-4e73-b067-df682915f9a6 tempest-VolumesListAdminTestJSON-2081180237 None] Created volume successfully. Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-82d60a69-dfd6-4948-9a9e-33705068f507-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-82d60a69-dfd6-4948-9a9e-33705068f507" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-82d60a69-dfd6-4948-9a9e-33705068f507" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb873972-5f5d-4c5e-8551-7229723454a5]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:51 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 Apr 10 10:39:51 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:52 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507" returned: 0 in 0.567s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:52 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507 Apr 10 10:39:52 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Acquiring lock "cinder-5096e0a4-82c7-463c-bc17-d8a637efe34d-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Lock "cinder-5096e0a4-82c7-463c-bc17-d8a637efe34d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Acquiring lock "cinder-quobyte-5096e0a4-82c7-463c-bc17-d8a637efe34d" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Lock "cinder-quobyte-5096e0a4-82c7-463c-bc17-d8a637efe34d" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[87554cc9-a28c-42d1-b1fb-17360c6c615b]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "cinder-a05f4ad2-12b9-4950-b8c5-7ccea3669e08-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-a05f4ad2-12b9-4950-b8c5-7ccea3669e08-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:52 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "cinder-quobyte-a05f4ad2-12b9-4950-b8c5-7ccea3669e08" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-82d60a69-dfd6-4948-9a9e-33705068f507" returned: 0 in 0.528s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:52 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d Apr 10 10:39:52 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-quobyte-a05f4ad2-12b9-4950-b8c5-7ccea3669e08" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-82d60a69-dfd6-4948-9a9e-33705068f507" released by "delete_volume" :: held 1.138s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e29dd9c-221b-4c30-b70c-fcf9d14d8353]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Created reservations ['de22d782-aed7-44fe-a27f-93b08cf2f81f', 'e71db673-4b95-42e9-bf21-5261dc135033', '7d77afb5-af46-42f7-a8cb-9af32690f9ac', '6bce7807-fb1a-4449-a121-c6d8ca6146f0'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:52 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08 Apr 10 10:39:52 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:52 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:52 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:53 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d" returned: 0 in 0.568s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:53 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d Apr 10 10:39:53 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:53 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08" returned: 0 in 0.601s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:53 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.521s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Deleted volume successfully. Apr 10 10:39:53 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08 Apr 10 10:39:53 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9c2ec094-8119-45c8-a1b7-c0d728f095ed tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-82d60a69-dfd6-4948-9a9e-33705068f507-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:53 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5096e0a4-82c7-463c-bc17-d8a637efe34d" returned: 0 in 0.534s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Lock "cinder-quobyte-5096e0a4-82c7-463c-bc17-d8a637efe34d" released by "delete_volume" :: held 1.131s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=135,cinder:UPDATE=187,cinder:INSERT=41,cinder:DELETE=12 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Created reservations ['c569ba65-2367-41d2-b017-5f88c9378fe6', '6884b6eb-c4b5-4296-b52a-cf41f2f4a06e', 'e18c56ec-1bb5-403c-a030-b6ae6e8a0a80', '4f3058a2-6c7a-4509-b5d1-acb45152c533'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-f105bd58-1f64-4ab0-8b69-3eb35d8a0261-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-f105bd58-1f64-4ab0-8b69-3eb35d8a0261-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:53 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:53 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "cinder-quobyte-f105bd58-1f64-4ab0-8b69-3eb35d8a0261" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:53 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-f105bd58-1f64-4ab0-8b69-3eb35d8a0261" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a05f4ad2-12b9-4950-b8c5-7ccea3669e08" returned: 0 in 0.578s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4da472b-c9a7-4432-9213-b7d3762e4cb3]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-quobyte-a05f4ad2-12b9-4950-b8c5-7ccea3669e08" released by "delete_volume" :: held 1.224s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:53 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Created reservations ['b213792d-b71a-4e30-9182-b79ec0a3af94', '594eb672-e7cf-4ed9-a727-22e747009367', '0aabe322-dd26-49ae-841a-88db19c2f387', '6ccf4a44-09a4-48bd-8644-a2a1f493c64c'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:53 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 Apr 10 10:39:53 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:54 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:54 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:54 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.469s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Deleted volume successfully. Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e594d36d-dd72-45f9-bbd7-47ac9763f38e tempest-VolumesListAdminTestJSON-2081180237 None] Lock "cinder-5096e0a4-82c7-463c-bc17-d8a637efe34d-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:54 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261" returned: 0 in 0.601s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:54 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.495s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Deleted volume successfully. Apr 10 10:39:54 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261 Apr 10 10:39:54 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-53b08dd3-4ba3-444b-8104-2272bb82bdb9 tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-a05f4ad2-12b9-4950-b8c5-7ccea3669e08-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "cinder-4e47e679-7d32-413a-9d96-db0484d6b5fd-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-4e47e679-7d32-413a-9d96-db0484d6b5fd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:54 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f105bd58-1f64-4ab0-8b69-3eb35d8a0261" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "cinder-quobyte-4e47e679-7d32-413a-9d96-db0484d6b5fd" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-quobyte-f105bd58-1f64-4ab0-8b69-3eb35d8a0261" released by "delete_volume" :: held 1.091s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-quobyte-4e47e679-7d32-413a-9d96-db0484d6b5fd" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[658de5e0-ab65-4a4f-ac78-44224cb98831]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Created reservations ['b8de095f-ba48-4adc-8fe8-6411aab700b6', '833982c2-26a3-4111-ba25-56650634e996', '605c7606-474d-4ed8-a462-c6d8dd01836f', '9794514f-33b6-411b-8d7c-45a798957d4f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:55 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:55 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:55 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd Apr 10 10:39:55 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:55 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.438s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:55 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Deleted volume successfully. Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7813e31a-b37f-41f0-9ec8-a42fa3f0f480 tempest-VolumesSnapshotTestJSON-1059589447 None] Lock "cinder-f105bd58-1f64-4ab0-8b69-3eb35d8a0261-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:55 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd" returned: 0 in 0.699s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:55 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd Apr 10 10:39:55 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:56 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4e47e679-7d32-413a-9d96-db0484d6b5fd" returned: 0 in 0.494s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-quobyte-4e47e679-7d32-413a-9d96-db0484d6b5fd" released by "delete_volume" :: held 1.219s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:DELETE=21,cinder:SELECT=140,cinder:INSERT=41,cinder:UPDATE=164 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Created reservations ['3a764c81-260e-4a73-b92e-1e82aa424402', 'ff7ace71-7966-4ffd-a03e-52773f7a1a50', '10cba1fc-499b-42ee-93da-3a7042122b30', '3c544ffb-5f20-46e8-9d27-dff2043d668e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:56 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:56 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:56 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.522s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:56 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Deleted volume successfully. Apr 10 10:39:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b34f5e45-0650-41f6-ab92-ac532a07aeef tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-4e47e679-7d32-413a-9d96-db0484d6b5fd-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "cinder-7f6c9888-3b21-4fec-9a54-3577fe0287df-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-7f6c9888-3b21-4fec-9a54-3577fe0287df-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "cinder-quobyte-7f6c9888-3b21-4fec-9a54-3577fe0287df" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-quobyte-7f6c9888-3b21-4fec-9a54-3577fe0287df" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a46603c-3c6c-413f-a85a-f3623320c873]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:57 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df Apr 10 10:39:57 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:57 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:57 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:57 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df" returned: 0 in 0.548s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:57 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df Apr 10 10:39:57 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:58 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.494s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:58 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7f6c9888-3b21-4fec-9a54-3577fe0287df" returned: 0 in 0.517s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:58 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-quobyte-7f6c9888-3b21-4fec-9a54-3577fe0287df" released by "delete_volume" :: held 1.095s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:58 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Created reservations ['3fcaf166-1f59-4a0b-acb2-b09500344617', '7a4dbd48-63bb-4bf2-bf9a-a6e304b5ca7d', '54e9d8f5-5197-407c-b92b-ca4db2d85bf7', '2e746f38-e8a4-48a3-9268-7ed431655651'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:58 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:39:58 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:59 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.613s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:59 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:59 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Deleted volume successfully. Apr 10 10:39:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-91127b7c-d35e-4e75-8589-79146c8c4ee7 tempest-VolumesListAdminTestJSON-450267209 None] Lock "cinder-7f6c9888-3b21-4fec-9a54-3577fe0287df-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Flow 'volume_create_manager' (30ec13de-9ddf-4513-a9ab-7a69951b1072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06875c16-d377-4429-87e6-b108808055b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06875c16-d377-4429-87e6-b108808055b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26ed2dd-b89d-4192-9757-47d30af2d100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0363ee2d1e8b423ea53d3ac3e5aa5fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:01Z,use_quota=True,user_id='6c4a63d64766475eae66dc41253bba8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bb78a7-cdd0-4883-8e13-7b807f1af4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bb78a7-cdd0-4883-8e13-7b807f1af4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a19851-8c8d-428b-b4c2-2bd02396e8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a19851-8c8d-428b-b4c2-2bd02396e8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26ed2dd-b89d-4192-9757-47d30af2d100', 'volume_name': 'volume-a26ed2dd-b89d-4192-9757-47d30af2d100', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e62a7d-d1fb-4db6-8325-cd8e555f6e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e62a7d-d1fb-4db6-8325-cd8e555f6e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba56bfa-b766-4246-bfcb-89207c71fa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:01 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Volume a26ed2dd-b89d-4192-9757-47d30af2d100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26ed2dd-b89d-4192-9757-47d30af2d100', 'volume_size': 1} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26ed2dd-b89d-4192-9757-47d30af2d100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0363ee2d1e8b423ea53d3ac3e5aa5fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:01Z,use_quota=True,user_id='6c4a63d64766475eae66dc41253bba8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Creating volume a26ed2dd-b89d-4192-9757-47d30af2d100 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:01 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:01 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100 1073741824 Apr 10 10:40:01 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:02 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100 1073741824" returned: 0 in 0.624s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:02 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100 Apr 10 10:40:02 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:02 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100" returned: 0 in 0.468s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba56bfa-b766-4246-bfcb-89207c71fa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26ed2dd-b89d-4192-9757-47d30af2d100', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46798e33-35bd-43b0-bf3f-ae8ff37c5160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:02 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Volume volume-a26ed2dd-b89d-4192-9757-47d30af2d100 (a26ed2dd-b89d-4192-9757-47d30af2d100): created successfully Apr 10 10:40:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46798e33-35bd-43b0-bf3f-ae8ff37c5160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:02 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Flow 'volume_create_manager' (30ec13de-9ddf-4513-a9ab-7a69951b1072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:02 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0a55f684-4ad5-4548-8121-7741dd53ec9b tempest-CinderUnicodeTest-1373187283 None] Created volume successfully. Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Flow 'volume_create_manager' (a0b6824c-e299-4bd9-ad19-92e05597f675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28baece5-d4ae-4c16-98ca-fd969fd8a473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28baece5-d4ae-4c16-98ca-fd969fd8a473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-146786631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f78ed9f-8f67-49fe-8e00-85b8a9591dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0363ee2d1e8b423ea53d3ac3e5aa5fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:04Z,use_quota=True,user_id='6c4a63d64766475eae66dc41253bba8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdad07f-0186-4f27-8626-dbaaf057ebed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdad07f-0186-4f27-8626-dbaaf057ebed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b8ca0f-6160-4ab7-89b4-1ab1b4444b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b8ca0f-6160-4ab7-89b4-1ab1b4444b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f78ed9f-8f67-49fe-8e00-85b8a9591dad', 'volume_name': 'volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76804b4b-e009-4c3a-988c-8868de8f49f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76804b4b-e009-4c3a-988c-8868de8f49f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc880af-8076-4b03-8967-82086501739f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:03 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Volume 3f78ed9f-8f67-49fe-8e00-85b8a9591dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad', 'volume_size': 1} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-146786631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f78ed9f-8f67-49fe-8e00-85b8a9591dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0363ee2d1e8b423ea53d3ac3e5aa5fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:04Z,use_quota=True,user_id='6c4a63d64766475eae66dc41253bba8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Creating volume 3f78ed9f-8f67-49fe-8e00-85b8a9591dad {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:03 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:03 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad 1073741824 Apr 10 10:40:03 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:04 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad 1073741824" returned: 0 in 0.575s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:04 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad Apr 10 10:40:04 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Flow 'volume_create_manager' (d7ab00e5-c9be-4e15-9b56-9d03557aa395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78800f70-aa0b-44e8-8afb-c8feb8c73a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78800f70-aa0b-44e8-8afb-c8feb8c73a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1460299357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab3e080-fcd3-4734-ae6b-8420781287e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5268863c7e43414d9a6c076a6948578a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:05Z,use_quota=True,user_id='a2106240e6dc49438f032550903e88a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0905ca1b-c4f1-460a-aafe-e70d8df1ca5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0905ca1b-c4f1-460a-aafe-e70d8df1ca5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5af79e-2899-45ef-a3f3-7584b2cdd5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5af79e-2899-45ef-a3f3-7584b2cdd5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab3e080-fcd3-4734-ae6b-8420781287e2', 'volume_name': 'volume-dab3e080-fcd3-4734-ae6b-8420781287e2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47421b41-0574-421c-8ec2-75f014966b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47421b41-0574-421c-8ec2-75f014966b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581a55b3-05fd-4cd2-aa72-1d0ad43586c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:05 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Volume dab3e080-fcd3-4734-ae6b-8420781287e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab3e080-fcd3-4734-ae6b-8420781287e2', 'volume_size': 1} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:05 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad" returned: 0 in 0.582s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1460299357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab3e080-fcd3-4734-ae6b-8420781287e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5268863c7e43414d9a6c076a6948578a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:05Z,use_quota=True,user_id='a2106240e6dc49438f032550903e88a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Creating volume dab3e080-fcd3-4734-ae6b-8420781287e2 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:05 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc880af-8076-4b03-8967-82086501739f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:05 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2 1073741824 Apr 10 10:40:05 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29925c16-491c-4b16-b1ca-ab08feb1f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:05 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Volume volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad (3f78ed9f-8f67-49fe-8e00-85b8a9591dad): created successfully Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29925c16-491c-4b16-b1ca-ab08feb1f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Flow 'volume_create_manager' (a0b6824c-e299-4bd9-ad19-92e05597f675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:05 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2a6af3c1-20c0-4f8b-a42e-e4c54317acd1 tempest-CinderUnicodeTest-1373187283 None] Created volume successfully. Apr 10 10:40:05 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2 1073741824" returned: 0 in 0.598s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:05 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2 Apr 10 10:40:05 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:06 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2" returned: 0 in 0.589s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.160s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581a55b3-05fd-4cd2-aa72-1d0ad43586c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab3e080-fcd3-4734-ae6b-8420781287e2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769832e4-7e75-4e58-b2b2-2670e4092294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] Creating offline snapshot fcecd387-921d-4125-aef4-6285da92f404 of volume 3f78ed9f-8f67-49fe-8e00-85b8a9591dad {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:40:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Volume volume-dab3e080-fcd3-4734-ae6b-8420781287e2 (dab3e080-fcd3-4734-ae6b-8420781287e2): created successfully Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769832e4-7e75-4e58-b2b2-2670e4092294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Flow 'volume_create_manager' (d7ab00e5-c9be-4e15-9b56-9d03557aa395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f077c5-fb9c-48c4-952e-17d186103cc2]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2989e35d-8c0b-4447-90f1-4e0025bf2c96 tempest-AbsoluteLimitsTests-1321263304 None] Created volume successfully. Apr 10 10:40:06 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad Apr 10 10:40:06 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:07 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad" returned: 0 in 0.631s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:07 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 1G Apr 10 10:40:07 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Acquiring lock "cinder-dab3e080-fcd3-4734-ae6b-8420781287e2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Lock "cinder-dab3e080-fcd3-4734-ae6b-8420781287e2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Acquiring lock "cinder-quobyte-dab3e080-fcd3-4734-ae6b-8420781287e2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Lock "cinder-quobyte-dab3e080-fcd3-4734-ae6b-8420781287e2" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:07 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23ddeab-fd6a-4d25-b73f-637e97cb018e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:07 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2 Apr 10 10:40:07 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:07 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 1G" returned: 0 in 0.642s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:07 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 Apr 10 10:40:07 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:08 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2" returned: 0 in 0.653s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:08 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2 Apr 10 10:40:08 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:08 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404" returned: 0 in 0.510s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:08 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 is being set with open permissions: ugo+rw Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:08 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 Apr 10 10:40:08 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:08 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-dab3e080-fcd3-4734-ae6b-8420781287e2" returned: 0 in 0.511s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Lock "cinder-quobyte-dab3e080-fcd3-4734-ae6b-8420781287e2" released by "delete_volume" :: held 1.200s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Created reservations ['5a0d07c0-d07d-4f1d-b8be-d5c4ae76086b', '30e7ceb3-c3da-4903-bf98-c27f56852d85', '3117188b-24bf-4716-b25c-d04379721c2d', '8794bbed-7a9d-4ff5-a7de-2c660c7716c6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:08 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:40:08 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:08 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404" returned: 0 in 0.593s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:08 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.info Apr 10 10:40:08 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:09 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.501s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:09 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Deleted volume successfully. Apr 10 10:40:09 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-89bebb05-f507-485c-b51a-bd140f3571ed tempest-AbsoluteLimitsTests-1321263304 None] Lock "cinder-dab3e080-fcd3-4734-ae6b-8420781287e2-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:09 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.info" returned: 0 in 0.470s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:09 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.info is being set with open permissions: ugo+rw Apr 10 10:40:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:09 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.info Apr 10 10:40:09 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:09 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.info" returned: 0 in 0.494s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.456s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a4050f94-852c-44af-89c3-d38e882793d8 tempest-CinderUnicodeTest-1373187283 None] Create snapshot completed successfully Apr 10 10:40:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "cinder-fcecd387-921d-4125-aef4-6285da92f404-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-fcecd387-921d-4125-aef4-6285da92f404-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "cinder-quobyte-3f78ed9f-8f67-49fe-8e00-85b8a9591dad" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-quobyte-3f78ed9f-8f67-49fe-8e00-85b8a9591dad" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "cinder-quobyte-fcecd387-921d-4125-aef4-6285da92f404" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-quobyte-fcecd387-921d-4125-aef4-6285da92f404" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Deleting offline snapshot fcecd387-921d-4125-aef4-6285da92f404 of volume 3f78ed9f-8f67-49fe-8e00-85b8a9591dad {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:40:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] snapshot_file for this snap is: volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:40:10 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[22826dfb-d829-48ba-9b3d-da2d06d47dd1]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:10 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 Apr 10 10:40:10 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:11 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404" returned: 0 in 0.627s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:40:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb642c54-ec0b-4805-acdb-49304768e881]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:11 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad Apr 10 10:40:11 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:11 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad" returned: 0 in 0.566s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:11 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 Apr 10 10:40:11 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:12 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404" returned: 0 in 0.562s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:12 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404 Apr 10 10:40:12 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Flow 'volume_create_manager' (e6a754fd-8760-4122-a75d-773a853e03a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38482233-a836-4679-a408-3cce8ddfffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38482233-a836-4679-a408-3cce8ddfffa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1660400192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175ec02b-8c9e-4203-8a8c-9abfbf2b59ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013d2e13c3bb469b80859d23e8eb5e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:13Z,use_quota=True,user_id='e401050491654fbaa7d4e98d02600335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7f2b10-90e8-4547-b25e-f5651e64dabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7f2b10-90e8-4547-b25e-f5651e64dabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b31528-a62f-4185-9536-8f983cdec80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b31528-a62f-4185-9536-8f983cdec80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '175ec02b-8c9e-4203-8a8c-9abfbf2b59ed', 'volume_name': 'volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed', 'volume_size': 2}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4af28c8-97ee-4ec3-8031-98ba2720052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4af28c8-97ee-4ec3-8031-98ba2720052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df12d0f7-70d8-4734-bc43-78d73247905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:12 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Volume 175ec02b-8c9e-4203-8a8c-9abfbf2b59ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed', 'volume_size': 2} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1660400192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175ec02b-8c9e-4203-8a8c-9abfbf2b59ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013d2e13c3bb469b80859d23e8eb5e20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:13Z,use_quota=True,user_id='e401050491654fbaa7d4e98d02600335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Creating volume 175ec02b-8c9e-4203-8a8c-9abfbf2b59ed {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:12 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed 2147483648 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:12 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed 2147483648 Apr 10 10:40:12 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:12 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad.fcecd387-921d-4125-aef4-6285da92f404" returned: 0 in 0.520s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-quobyte-fcecd387-921d-4125-aef4-6285da92f404" released by "_delete_snapshot" :: held 2.350s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-quobyte-3f78ed9f-8f67-49fe-8e00-85b8a9591dad" released by "delete_snapshot" :: held 2.365s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Created reservations ['d2c8f618-0dbf-4440-96df-1ffff829569e', 'ad25c7e5-682e-4bf3-8153-9c9b1102435b', 'd54f3f7d-f415-41c8-b590-cd2a05c4499a', '9845fdb1-3278-48e8-9b95-cb2df0b26c6b'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Delete snapshot completed successfully. Apr 10 10:40:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7802ba01-d4f1-4734-8b9c-2f68fcec2648 tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-fcecd387-921d-4125-aef4-6285da92f404-delete_snapshot" released by "delete_snapshot" :: held 2.473s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:13 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed 2147483648" returned: 0 in 0.597s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:13 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed Apr 10 10:40:13 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "cinder-3f78ed9f-8f67-49fe-8e00-85b8a9591dad-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-3f78ed9f-8f67-49fe-8e00-85b8a9591dad-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "cinder-quobyte-3f78ed9f-8f67-49fe-8e00-85b8a9591dad" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-quobyte-3f78ed9f-8f67-49fe-8e00-85b8a9591dad" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[34127336-a18f-4fa9-bd5c-40257a929a55]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:13 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad Apr 10 10:40:13 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:13 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed" returned: 0 in 0.485s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df12d0f7-70d8-4734-bc43-78d73247905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed', 'volume_size': 2}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a95e9d-bb42-46eb-94ee-46b61659abb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:13 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Volume volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed (175ec02b-8c9e-4203-8a8c-9abfbf2b59ed): created successfully Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a95e9d-bb42-46eb-94ee-46b61659abb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Flow 'volume_create_manager' (e6a754fd-8760-4122-a75d-773a853e03a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:13 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c3c3635e-313e-47cf-8041-f8e5984d677a tempest-VolumesCloneNegativeTest-732660429 None] Created volume successfully. Apr 10 10:40:14 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad" returned: 0 in 0.528s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:14 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad Apr 10 10:40:14 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:14 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-3f78ed9f-8f67-49fe-8e00-85b8a9591dad" returned: 0 in 0.510s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-quobyte-3f78ed9f-8f67-49fe-8e00-85b8a9591dad" released by "delete_volume" :: held 1.082s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Created reservations ['d08a6af6-8030-4625-a387-d32a5b73bb99', '534694f1-0452-4383-90c2-0fff1f79c573', '0001d1a6-47b4-48b5-a513-6148c34ce384', '57cf4819-d9cb-4508-8c78-e6a91fdc6c40'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:14 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:40:14 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Acquiring lock "cinder-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Lock "cinder-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Acquiring lock "cinder-quobyte-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Lock "cinder-quobyte-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e954827-5412-472e-bbdb-9bd250ca1897]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:15 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed Apr 10 10:40:15 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:15 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.547s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:15 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Deleted volume successfully. Apr 10 10:40:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-146c595f-3658-458b-9368-e1f8a08699c1 tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-3f78ed9f-8f67-49fe-8e00-85b8a9591dad-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:15 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed" returned: 0 in 0.530s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:15 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed Apr 10 10:40:15 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "cinder-a26ed2dd-b89d-4192-9757-47d30af2d100-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-a26ed2dd-b89d-4192-9757-47d30af2d100-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "cinder-quobyte-a26ed2dd-b89d-4192-9757-47d30af2d100" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-quobyte-a26ed2dd-b89d-4192-9757-47d30af2d100" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc95103-8d5d-4ce4-add8-4885bf86778f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:15 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100 Apr 10 10:40:15 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:16 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed" returned: 0 in 0.516s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Lock "cinder-quobyte-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed" released by "delete_volume" :: held 1.073s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Created reservations ['153014f0-76bd-4e0b-8756-0fda9394be28', 'd01967f7-fe48-4a0f-9f99-a2b5679553cd', '5280c10d-47aa-471e-99c0-493810523358', 'eddf8b24-b035-4b3a-8452-e960a416dbad'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:16 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:40:16 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:16 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100" returned: 0 in 0.529s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:16 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100 Apr 10 10:40:16 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:16 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.471s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Deleted volume successfully. Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9e3ca7fc-6c72-48c9-9f13-2231b3526f19 tempest-VolumesCloneNegativeTest-732660429 None] Lock "cinder-175ec02b-8c9e-4203-8a8c-9abfbf2b59ed-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:16 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a26ed2dd-b89d-4192-9757-47d30af2d100" returned: 0 in 0.469s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-quobyte-a26ed2dd-b89d-4192-9757-47d30af2d100" released by "delete_volume" :: held 1.028s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Created reservations ['f97c08fc-bdf2-485c-bbf5-a06ca8fe6cf8', '891e725e-894d-4b1f-9248-f4c0f3082672', '2a545877-5eb5-4efc-9cdb-a8e34b3f335c', 'f9221acc-f57f-4b38-972e-f5ced65391f2'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:16 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:40:16 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:17 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.456s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:17 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Deleted volume successfully. Apr 10 10:40:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-a4a76af4-dae3-4404-95de-271ba65cf8aa tempest-CinderUnicodeTest-1373187283 None] Lock "cinder-a26ed2dd-b89d-4192-9757-47d30af2d100-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Flow 'volume_create_manager' (d762721c-4334-4405-aec6-cae889267512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe59622-7454-49e6-8082-e0116c0ae952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe59622-7454-49e6-8082-e0116c0ae952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-446553815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d2de2a-1488-46bf-a0ab-45ce79a6e144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5e41c8da774959b255c54c63892280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:21Z,use_quota=True,user_id='6f28637febb946658739e1d2492ffbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70de7549-3f86-4d97-973d-497a628887d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70de7549-3f86-4d97-973d-497a628887d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6cd4e3-bb65-4b79-8ca6-43a01d10cffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6cd4e3-bb65-4b79-8ca6-43a01d10cffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d2de2a-1488-46bf-a0ab-45ce79a6e144', 'volume_name': 'volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144', 'volume_size': 2}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a9c9fd-52d3-49e1-b8c7-611de194b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a9c9fd-52d3-49e1-b8c7-611de194b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aca0143-dffd-4611-9651-ef26570db09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:21 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Volume 46d2de2a-1488-46bf-a0ab-45ce79a6e144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144', 'volume_size': 2} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-446553815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d2de2a-1488-46bf-a0ab-45ce79a6e144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5e41c8da774959b255c54c63892280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:21Z,use_quota=True,user_id='6f28637febb946658739e1d2492ffbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Creating volume 46d2de2a-1488-46bf-a0ab-45ce79a6e144 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:21 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 2147483648 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:21 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 2147483648 Apr 10 10:40:21 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:21 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 2147483648" returned: 0 in 0.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:21 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 Apr 10 10:40:21 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:22 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144" returned: 0 in 0.457s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aca0143-dffd-4611-9651-ef26570db09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144', 'volume_size': 2}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd48c17-eb19-4449-ada3-76921f3968ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:22 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Volume volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 (46d2de2a-1488-46bf-a0ab-45ce79a6e144): created successfully Apr 10 10:40:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd48c17-eb19-4449-ada3-76921f3968ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:22 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Flow 'volume_create_manager' (d762721c-4334-4405-aec6-cae889267512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:22 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ff1d5785-e639-4a12-a2b5-b864d41234e2 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Created volume successfully. Apr 10 10:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:23 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Creating offline snapshot f1b9ae61-be16-4692-a828-04b6c14d9f03 of volume 46d2de2a-1488-46bf-a0ab-45ce79a6e144 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:40:23 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb00da3-29bc-4f73-b83b-4085ca0c7fba]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:23 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 Apr 10 10:40:23 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:23 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144" returned: 0 in 0.472s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 2G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:23 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 2G Apr 10 10:40:23 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:24 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 2G" returned: 0 in 0.469s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:24 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 Apr 10 10:40:24 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:24 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03" returned: 0 in 0.440s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:24 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 is being set with open permissions: ugo+rw Apr 10 10:40:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:24 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 Apr 10 10:40:24 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:25 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03" returned: 0 in 0.455s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:25 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.info Apr 10 10:40:25 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:25 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.info" returned: 0 in 0.517s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:25 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.info is being set with open permissions: ugo+rw Apr 10 10:40:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:25 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.info Apr 10 10:40:25 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:26 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.info" returned: 0 in 0.506s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.931s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6a1ca32c-5e0f-413d-a246-0b8bace493e7 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Create snapshot completed successfully Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Acquiring lock "cinder-f1b9ae61-be16-4692-a828-04b6c14d9f03-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "cinder-f1b9ae61-be16-4692-a828-04b6c14d9f03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Acquiring lock "cinder-quobyte-46d2de2a-1488-46bf-a0ab-45ce79a6e144" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "cinder-quobyte-46d2de2a-1488-46bf-a0ab-45ce79a6e144" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Acquiring lock "cinder-quobyte-f1b9ae61-be16-4692-a828-04b6c14d9f03" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "cinder-quobyte-f1b9ae61-be16-4692-a828-04b6c14d9f03" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Deleting offline snapshot f1b9ae61-be16-4692-a828-04b6c14d9f03 of volume 46d2de2a-1488-46bf-a0ab-45ce79a6e144 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] snapshot_file for this snap is: volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9609f3e-c967-4cb6-ab07-f1b97e871504]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:26 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 Apr 10 10:40:26 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:27 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03" returned: 0 in 0.512s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:40:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e994753-7b0f-4bb5-84d5-d6e57de7fd57]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:27 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 Apr 10 10:40:27 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:27 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144" returned: 0 in 0.510s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:27 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 Apr 10 10:40:27 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:28 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03" returned: 0 in 0.490s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:28 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03 Apr 10 10:40:28 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:28 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144.f1b9ae61-be16-4692-a828-04b6c14d9f03" returned: 0 in 0.505s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "cinder-quobyte-f1b9ae61-be16-4692-a828-04b6c14d9f03" released by "_delete_snapshot" :: held 2.082s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "cinder-quobyte-46d2de2a-1488-46bf-a0ab-45ce79a6e144" released by "delete_snapshot" :: held 2.095s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:28 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Created reservations ['a88a9a2d-cce4-46fa-9d07-835ee17ceccc', '91d741c2-2def-4f77-9321-b0cb07c8dc2c', '7e57fd30-8985-419b-b14a-f90029b47b58', '46947350-665e-4a77-8345-83674196cc9e'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Delete snapshot completed successfully. Apr 10 10:40:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-cc2a6db4-16cf-40aa-8618-bd76fa4db088 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "cinder-f1b9ae61-be16-4692-a828-04b6c14d9f03-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Acquiring lock "cinder-46d2de2a-1488-46bf-a0ab-45ce79a6e144-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "cinder-46d2de2a-1488-46bf-a0ab-45ce79a6e144-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Acquiring lock "cinder-quobyte-46d2de2a-1488-46bf-a0ab-45ce79a6e144" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "cinder-quobyte-46d2de2a-1488-46bf-a0ab-45ce79a6e144" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7093a98b-a98e-44d3-a5d3-c5051adbbc40]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:29 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 Apr 10 10:40:29 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:30 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144" returned: 0 in 0.518s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:30 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144 Apr 10 10:40:30 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:30 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-46d2de2a-1488-46bf-a0ab-45ce79a6e144" returned: 0 in 0.500s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "cinder-quobyte-46d2de2a-1488-46bf-a0ab-45ce79a6e144" released by "delete_volume" :: held 1.069s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:30 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Created reservations ['01750844-ce95-4ed6-80dd-dc0507a1e384', '00ccafd6-5a17-49c8-b14f-f18750bdd586', '43010d79-efdd-4866-a199-420aee31adbd', 'de971ace-d9dd-4452-953f-e094c273cb8c'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:30 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:40:30 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:31 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.447s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:31 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:31 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Deleted volume successfully. Apr 10 10:40:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f73035f2-46d1-447c-b3de-26aa976465d0 tempest-VolumesSnapshotNegativeTestJSON-1672742305 None] Lock "cinder-46d2de2a-1488-46bf-a0ab-45ce79a6e144-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Flow 'volume_create_manager' (22cf198f-c807-4189-adb8-61cc96567ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc78dc7-ea25-41d7-9345-9223b2af2025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc78dc7-ea25-41d7-9345-9223b2af2025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1906187223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c22a99-49a7-4eb4-bf27-e473cef5ce4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd148d28cdd64942a2f832a1553e45ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:40Z,use_quota=True,user_id='9c8f1afb34bf47dea150f48623235fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383cdc14-4f89-4c99-a0eb-bd71457d48d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383cdc14-4f89-4c99-a0eb-bd71457d48d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f35727d-d6fb-4b14-87db-8de7e35f1ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f35727d-d6fb-4b14-87db-8de7e35f1ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c22a99-49a7-4eb4-bf27-e473cef5ce4e', 'volume_name': 'volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623f2adb-8852-4615-9b56-6e20768d547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (623f2adb-8852-4615-9b56-6e20768d547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97bb10d-84ff-4938-a0e7-4050dcccb8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Volume 36c22a99-49a7-4eb4-bf27-e473cef5ce4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e', 'volume_size': 1} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1906187223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c22a99-49a7-4eb4-bf27-e473cef5ce4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd148d28cdd64942a2f832a1553e45ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:40Z,use_quota=True,user_id='9c8f1afb34bf47dea150f48623235fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Creating volume 36c22a99-49a7-4eb4-bf27-e473cef5ce4e {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:40 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (9222f66b-40cd-45fb-8d8a-ef13a23ab630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51dce757-a8a7-4fa2-9cba-8fd862d28bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e 1073741824 Apr 10 10:40:40 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51dce757-a8a7-4fa2-9cba-8fd862d28bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1190286863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd75232-a453-4426-b855-f3e0068ad1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:40Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3191a5f7-6cf8-4f2b-9437-f50e0e174186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3191a5f7-6cf8-4f2b-9437-f50e0e174186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50ddc53-1cc1-4ef7-b0da-0624faeb6e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50ddc53-1cc1-4ef7-b0da-0624faeb6e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd75232-a453-4426-b855-f3e0068ad1d6', 'volume_name': 'volume-2dd75232-a453-4426-b855-f3e0068ad1d6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba19098-1599-4229-8517-8eb9ea3125cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba19098-1599-4229-8517-8eb9ea3125cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60adae7f-b047-448c-8feb-e81db277c914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume 2dd75232-a453-4426-b855-f3e0068ad1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd75232-a453-4426-b855-f3e0068ad1d6', 'volume_size': 1} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Flow 'volume_create_manager' (1f1ecd49-791c-4d9a-a379-cd232c20e1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fccfff-e51f-454c-b9e0-3442bbb7d6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fccfff-e51f-454c-b9e0-3442bbb7d6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1148812237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4af3e1d-d8fc-4005-8920-be38cecb0dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b573c0ecd9d748bca40d267ac0e1cd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:41Z,use_quota=True,user_id='dea4d1a61f694753a9b11d250c2d9bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afabb52-f764-4e60-a22f-b047a42c9fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5afabb52-f764-4e60-a22f-b047a42c9fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29cd6ba3-244d-4d24-9b16-f66f638835ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29cd6ba3-244d-4d24-9b16-f66f638835ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4af3e1d-d8fc-4005-8920-be38cecb0dc4', 'volume_name': 'volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d623d98d-5e2b-4fa6-9d1a-74f585c9f9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d623d98d-5e2b-4fa6-9d1a-74f585c9f9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58eb115-52d8-413a-8156-804671b6f86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Volume a4af3e1d-d8fc-4005-8920-be38cecb0dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4', 'volume_size': 1} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Flow 'volume_create_manager' (fdcc1552-eb0d-4cdf-8092-a0ac3298535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4df82b-254a-4619-9e7d-6bfd680f39a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4df82b-254a-4619-9e7d-6bfd680f39a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100066012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4548952f-b133-4633-af2a-b483172f7822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b573c0ecd9d748bca40d267ac0e1cd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:41Z,use_quota=True,user_id='dea4d1a61f694753a9b11d250c2d9bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35735ae-dd09-4cb1-aaf3-419323117fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35735ae-dd09-4cb1-aaf3-419323117fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1156a0-d535-4bdf-b888-ad09f1e1950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1156a0-d535-4bdf-b888-ad09f1e1950b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4548952f-b133-4633-af2a-b483172f7822', 'volume_name': 'volume-4548952f-b133-4633-af2a-b483172f7822', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a0e4a6-69d1-4bf1-b2a2-010429e6daf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a0e4a6-69d1-4bf1-b2a2-010429e6daf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64885ef-248c-4233-b76a-7e231f1af3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Volume 4548952f-b133-4633-af2a-b483172f7822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4548952f-b133-4633-af2a-b483172f7822', 'volume_size': 1} Apr 10 10:40:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Flow 'volume_create_manager' (08125532-c24c-4c38-a0ca-3a0cd3e32a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3e1433-f45a-472f-9462-3e3c7207487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3e1433-f45a-472f-9462-3e3c7207487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1830022348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b573c0ecd9d748bca40d267ac0e1cd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:41Z,use_quota=True,user_id='dea4d1a61f694753a9b11d250c2d9bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7aba26-9c92-4355-8972-668259a80aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7aba26-9c92-4355-8972-668259a80aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a5927b-952e-4db4-a43b-495942b3b307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a5927b-952e-4db4-a43b-495942b3b307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a', 'volume_name': 'volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b36cc4-297d-40f4-aa12-157d072ced01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b36cc4-297d-40f4-aa12-157d072ced01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1df22f9-c75e-49c7-9b5a-88d67ccf54be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Volume e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a', 'volume_size': 1} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:41 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e 1073741824" returned: 0 in 0.835s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:41 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e Apr 10 10:40:41 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Flow 'volume_create_manager' (53485a20-c11c-4cc1-9cd7-ccd514e074d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756c9634-aa9d-4c73-9b5c-8e97e14880a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756c9634-aa9d-4c73-9b5c-8e97e14880a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1995640218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a9bf6b-cd16-40ce-9499-86da477a984a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b573c0ecd9d748bca40d267ac0e1cd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:41Z,use_quota=True,user_id='dea4d1a61f694753a9b11d250c2d9bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b828abef-b739-48c2-aad5-c3294b7522fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b828abef-b739-48c2-aad5-c3294b7522fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8086d8e9-4196-40f1-bf4a-1d0a988414a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8086d8e9-4196-40f1-bf4a-1d0a988414a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a9bf6b-cd16-40ce-9499-86da477a984a', 'volume_name': 'volume-04a9bf6b-cd16-40ce-9499-86da477a984a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a67881-9f26-4fed-894b-7f4bd5cba601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a67881-9f26-4fed-894b-7f4bd5cba601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fdf53e-20e0-4a7c-a563-c516cc8bf960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Volume 04a9bf6b-cd16-40ce-9499-86da477a984a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a9bf6b-cd16-40ce-9499-86da477a984a', 'volume_size': 1} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Flow 'volume_create_manager' (a9837f27-3514-481a-89a6-5498eedff854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df932baa-2fd9-40b2-8249-2a9de40e9e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df932baa-2fd9-40b2-8249-2a9de40e9e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-159502158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eed45bc-b4ba-439e-95d1-a2564e4c8397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b573c0ecd9d748bca40d267ac0e1cd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:42Z,use_quota=True,user_id='dea4d1a61f694753a9b11d250c2d9bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8de86aa-b5d3-414f-b94f-d7d1f89381a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8de86aa-b5d3-414f-b94f-d7d1f89381a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72346ce2-66ba-482a-a134-a3a518888121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72346ce2-66ba-482a-a134-a3a518888121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eed45bc-b4ba-439e-95d1-a2564e4c8397', 'volume_name': 'volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b51952b-272b-4e3c-aa84-407cc329f2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b51952b-272b-4e3c-aa84-407cc329f2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8eba51c-75a6-48af-809a-09b64efc9139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Volume 1eed45bc-b4ba-439e-95d1-a2564e4c8397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397', 'volume_size': 1} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:41 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" returned: 0 in 0.562s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.288s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1190286863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd75232-a453-4426-b855-f3e0068ad1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:40Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Creating volume 2dd75232-a453-4426-b855-f3e0068ad1d6 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:41 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f97bb10d-84ff-4938-a0e7-4050dcccb8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 1073741824 Apr 10 10:40:41 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a94256d-78a4-489c-8096-808f80f3c214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Volume volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e (36c22a99-49a7-4eb4-bf27-e473cef5ce4e): created successfully Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a94256d-78a4-489c-8096-808f80f3c214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Flow 'volume_create_manager' (22cf198f-c807-4189-adb8-61cc96567ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:41 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-06f00cb1-cb52-4502-9057-0a1c2c3743b9 tempest-VolumeDependencyTests-613899977 None] Created volume successfully. Apr 10 10:40:42 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 1073741824" returned: 0 in 0.708s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:42 devstack sudo[90524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 Apr 10 10:40:42 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:43 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.433s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1148812237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4af3e1d-d8fc-4005-8920-be38cecb0dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b573c0ecd9d748bca40d267ac0e1cd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:41Z,use_quota=True,user_id='dea4d1a61f694753a9b11d250c2d9bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Creating volume a4af3e1d-d8fc-4005-8920-be38cecb0dc4 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:43 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60adae7f-b047-448c-8feb-e81db277c914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd75232-a453-4426-b855-f3e0068ad1d6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:43 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4 1073741824 Apr 10 10:40:43 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2340eb87-b1a2-43b4-9d10-f2c6541a5d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:43 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume volume-2dd75232-a453-4426-b855-f3e0068ad1d6 (2dd75232-a453-4426-b855-f3e0068ad1d6): created successfully Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2340eb87-b1a2-43b4-9d10-f2c6541a5d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (9222f66b-40cd-45fb-8d8a-ef13a23ab630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-25896139-d6d1-467d-8408-021434afd201 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created volume successfully. Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:43 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4 1073741824" returned: 0 in 0.647s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:43 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4 Apr 10 10:40:43 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:44 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4" returned: 0 in 0.453s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.356s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100066012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4548952f-b133-4633-af2a-b483172f7822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b573c0ecd9d748bca40d267ac0e1cd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:41Z,use_quota=True,user_id='dea4d1a61f694753a9b11d250c2d9bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Creating volume 4548952f-b133-4633-af2a-b483172f7822 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:44 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58eb115-52d8-413a-8156-804671b6f86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefdc891-93c1-4b84-9d8a-124956a97bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:44 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822 1073741824 Apr 10 10:40:44 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:44 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Volume volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4 (a4af3e1d-d8fc-4005-8920-be38cecb0dc4): created successfully Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eefdc891-93c1-4b84-9d8a-124956a97bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Flow 'volume_create_manager' (1f1ecd49-791c-4d9a-a379-cd232c20e1f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:44 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7962a8f0-acef-4d8c-8a7b-111150831032 tempest-CreateVolumesFromImageTest-1240536497 None] Created volume successfully. Apr 10 10:40:44 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822 1073741824" returned: 0 in 0.660s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:45 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822 Apr 10 10:40:45 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:45 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822" returned: 0 in 0.473s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.285s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1830022348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b573c0ecd9d748bca40d267ac0e1cd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:41Z,use_quota=True,user_id='dea4d1a61f694753a9b11d250c2d9bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Creating volume e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:45 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64885ef-248c-4233-b76a-7e231f1af3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4548952f-b133-4633-af2a-b483172f7822', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aab7978-c130-4b0a-966c-de5caab0a916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:45 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a 1073741824 Apr 10 10:40:45 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:45 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Volume volume-4548952f-b133-4633-af2a-b483172f7822 (4548952f-b133-4633-af2a-b483172f7822): created successfully Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aab7978-c130-4b0a-966c-de5caab0a916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:45 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Flow 'volume_create_manager' (fdcc1552-eb0d-4cdf-8092-a0ac3298535c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-dac600e1-e0e7-43d1-98b9-3b28ab093413 tempest-CreateVolumesFromImageTest-1240536497 None] Created volume successfully. Apr 10 10:40:46 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a 1073741824" returned: 0 in 0.742s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:46 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a Apr 10 10:40:46 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:46 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a" returned: 0 in 0.544s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.369s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1995640218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a9bf6b-cd16-40ce-9499-86da477a984a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b573c0ecd9d748bca40d267ac0e1cd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:41Z,use_quota=True,user_id='dea4d1a61f694753a9b11d250c2d9bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Creating volume 04a9bf6b-cd16-40ce-9499-86da477a984a {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:46 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:46 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a 1073741824 Apr 10 10:40:46 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1df22f9-c75e-49c7-9b5a-88d67ccf54be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225530e9-ba0d-4d66-be05-47a9f1b07408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:46 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Volume volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a (e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a): created successfully Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225530e9-ba0d-4d66-be05-47a9f1b07408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:46 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Flow 'volume_create_manager' (08125532-c24c-4c38-a0ca-3a0cd3e32a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:46 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3b6ecf01-3602-486f-9249-b7007fbecd91 tempest-CreateVolumesFromImageTest-1240536497 None] Created volume successfully. Apr 10 10:40:47 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a 1073741824" returned: 0 in 0.650s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:47 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a Apr 10 10:40:47 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:48 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a" returned: 0 in 0.541s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.303s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-159502158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eed45bc-b4ba-439e-95d1-a2564e4c8397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b573c0ecd9d748bca40d267ac0e1cd1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:42Z,use_quota=True,user_id='dea4d1a61f694753a9b11d250c2d9bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Creating volume 1eed45bc-b4ba-439e-95d1-a2564e4c8397 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:48 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fdf53e-20e0-4a7c-a563-c516cc8bf960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a9bf6b-cd16-40ce-9499-86da477a984a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0af5b6f-ec9d-431b-8888-294b7e97b73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:48 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397 1073741824 Apr 10 10:40:48 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:48 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Volume volume-04a9bf6b-cd16-40ce-9499-86da477a984a (04a9bf6b-cd16-40ce-9499-86da477a984a): created successfully Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0af5b6f-ec9d-431b-8888-294b7e97b73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Flow 'volume_create_manager' (53485a20-c11c-4cc1-9cd7-ccd514e074d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-1826ddd8-eff4-485c-ab30-431843a38560 tempest-CreateVolumesFromImageTest-1240536497 None] Created volume successfully. Apr 10 10:40:48 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397 1073741824" returned: 0 in 0.651s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:48 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397 Apr 10 10:40:48 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:49 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397" returned: 0 in 0.572s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.729s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8eba51c-75a6-48af-809a-09b64efc9139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef058c4f-d9ea-489b-a77b-dd850b24ba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] Creating offline snapshot d052fd2e-8c31-42f4-9241-fcde50ce035f of volume 36c22a99-49a7-4eb4-bf27-e473cef5ce4e {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:40:49 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Volume volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397 (1eed45bc-b4ba-439e-95d1-a2564e4c8397): created successfully Apr 10 10:40:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef058c4f-d9ea-489b-a77b-dd850b24ba6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:49 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Flow 'volume_create_manager' (a9837f27-3514-481a-89a6-5498eedff854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:49 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ba3c82-6aaa-48a5-9fb3-1d448335f595]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:49 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8e2a67cd-65a8-43f7-bea1-92f514347be1 tempest-CreateVolumesFromImageTest-1240536497 None] Created volume successfully. Apr 10 10:40:49 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e Apr 10 10:40:49 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:50 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" returned: 0 in 0.585s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:50 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f 1G Apr 10 10:40:50 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "cinder-1eed45bc-b4ba-439e-95d1-a2564e4c8397-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-1eed45bc-b4ba-439e-95d1-a2564e4c8397-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:50 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "cinder-quobyte-1eed45bc-b4ba-439e-95d1-a2564e4c8397" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f 1G" returned: 0 in 0.582s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:50 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f Apr 10 10:40:50 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-quobyte-1eed45bc-b4ba-439e-95d1-a2564e4c8397" acquired by "delete_volume" :: waited 0.034s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:50 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cc3d5c-29f0-4080-beb1-23a7ce52c225]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:50 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397 Apr 10 10:40:50 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:51 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f" returned: 0 in 0.624s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:51 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f is being set with open permissions: ugo+rw Apr 10 10:40:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:51 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f Apr 10 10:40:51 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:51 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397" returned: 0 in 0.628s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:51 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397 Apr 10 10:40:51 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:51 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f" returned: 0 in 0.627s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:51 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:51 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1eed45bc-b4ba-439e-95d1-a2564e4c8397" returned: 0 in 0.610s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:51 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-quobyte-1eed45bc-b4ba-439e-95d1-a2564e4c8397" released by "delete_volume" :: held 1.281s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:51 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.info Apr 10 10:40:51 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:51 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Created reservations ['763a2a59-0b11-482d-8db1-ff58fd060092', '6149c4ed-89b9-43eb-957a-44e7d1950c97', '91a67d53-dcff-40e4-bceb-d4e6b18ce63d', 'cdf59e01-1e8c-4216-9459-116676e4928b'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:52 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:40:52 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:52 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.info" returned: 0 in 0.632s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:52 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.info is being set with open permissions: ugo+rw Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:52 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.info Apr 10 10:40:52 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:52 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.685s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:52 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Deleted volume successfully. Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b45cabd5-94b0-4efa-baf7-beb790969c62 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-1eed45bc-b4ba-439e-95d1-a2564e4c8397-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "cinder-04a9bf6b-cd16-40ce-9499-86da477a984a-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-04a9bf6b-cd16-40ce-9499-86da477a984a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "cinder-quobyte-04a9bf6b-cd16-40ce-9499-86da477a984a" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-quobyte-04a9bf6b-cd16-40ce-9499-86da477a984a" acquired by "delete_volume" :: waited 0.035s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a9b23c-263b-48e7-afe8-86634fede9e3]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:52 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:53 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a Apr 10 10:40:53 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:53 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.info" returned: 0 in 0.639s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.798s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.519s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:53 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] Creating offline snapshot 8895a0cc-cec2-4a41-a045-2d4b2faf583d of volume 2dd75232-a453-4426-b855-f3e0068ad1d6 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:40:53 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-6f42ec72-f094-4453-8d48-bc7ef2f8e41e tempest-VolumeDependencyTests-613899977 None] Create snapshot completed successfully Apr 10 10:40:53 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14de3e2-fd9b-46eb-9db1-2e21d87d145d]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:53 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 Apr 10 10:40:53 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:53 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a" returned: 0 in 0.612s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:53 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a Apr 10 10:40:53 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:53 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6" returned: 0 in 0.658s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:53 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:53 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d 1G Apr 10 10:40:53 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:54 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-04a9bf6b-cd16-40ce-9499-86da477a984a" returned: 0 in 0.532s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-quobyte-04a9bf6b-cd16-40ce-9499-86da477a984a" released by "delete_volume" :: held 1.200s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:UPDATE=134,cinder:SELECT=101,cinder:INSERT=35,cinder:DELETE=11 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Created reservations ['f64ee555-155d-46d7-b48f-b0b5d1f31859', 'a624cacb-df2d-447b-b67b-47a7a5e096a1', 'e95d2d37-8102-46d8-9f8f-094f2bdbbb53', 'dede3d1e-8e7c-4f2e-b9e9-db76fbda5b79'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:54 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:40:54 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Flow 'volume_create_manager' (7ea65ee4-f268-42f7-adf5-11553afec716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d608f5-9921-4091-b5ca-0226a90abbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d608f5-9921-4091-b5ca-0226a90abbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1443934909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08a9a75-e8e9-40b5-97df-f18b868d3b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd148d28cdd64942a2f832a1553e45ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d052fd2e-8c31-42f4-9241-fcde50ce035f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:55Z,use_quota=True,user_id='9c8f1afb34bf47dea150f48623235fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8281b572-8834-4479-b9e3-0d4fcd2ba026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8281b572-8834-4479-b9e3-0d4fcd2ba026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:54 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de451d72-37d4-440c-b884-ce492669e0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de451d72-37d4-440c-b884-ce492669e0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd08a9a75-e8e9-40b5-97df-f18b868d3b5f', 'volume_name': 'volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f', 'volume_size': 1, 'snapshot_id': 'd052fd2e-8c31-42f4-9241-fcde50ce035f'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b402b5-ad7d-4b0a-a85d-007786b25b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b402b5-ad7d-4b0a-a85d-007786b25b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5d2464-db01-42c9-9bdb-eeef75cf9980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:54 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Volume d08a9a75-e8e9-40b5-97df-f18b868d3b5f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f', 'volume_size': 1, 'snapshot_id': 'd052fd2e-8c31-42f4-9241-fcde50ce035f'} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d 1G" returned: 0 in 0.797s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dd75232-a453-4426-b855-f3e0068ad1d6 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:54 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dd75232-a453-4426-b855-f3e0068ad1d6 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d Apr 10 10:40:54 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:54 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.617s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:54 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Deleted volume successfully. Apr 10 10:40:54 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3e12311f-9fe7-4a5a-ab37-a3ea178b23ee tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-04a9bf6b-cd16-40ce-9499-86da477a984a-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "cinder-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "cinder-quobyte-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-quobyte-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[39db268b-fa53-44a7-a2e0-da37146e58ad]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:55 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a Apr 10 10:40:55 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:55 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2dd75232-a453-4426-b855-f3e0068ad1d6 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d" returned: 0 in 0.628s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:55 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d is being set with open permissions: ugo+rw Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:55 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d Apr 10 10:40:55 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:55 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a" returned: 0 in 0.583s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:55 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a Apr 10 10:40:55 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:55 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d" returned: 0 in 0.576s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:55 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:55 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.info Apr 10 10:40:55 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:56 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a" returned: 0 in 0.519s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-quobyte-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a" released by "delete_volume" :: held 1.146s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Created reservations ['da8079fa-d033-4899-b1ad-4223d6e46414', '333448ba-8450-4c5f-9bdf-f3b434f43dd2', '066af75e-c456-4347-9a09-43b9fd7647ad', 'd60f9cba-c694-427b-8b8f-218bda4c72e9'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=96,cinder:UPDATE=125,cinder:DELETE=14,cinder:INSERT=29 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:56 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:40:56 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:56 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.info" returned: 0 in 0.573s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:56 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.info is being set with open permissions: ugo+rw Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:56 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.info Apr 10 10:40:56 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:56 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.536s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:56 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Deleted volume successfully. Apr 10 10:40:56 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-e18825dd-25d4-4099-a63c-fa82b3baa10e tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-e29a45b1-d2cc-40ec-ac23-5ac7a4cd354a-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:57 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.info" returned: 0 in 0.639s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.966s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.454s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-quobyte-d052fd2e-8c31-42f4-9241-fcde50ce035f-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-d052fd2e-8c31-42f4-9241-fcde50ce035f-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Creating volume d08a9a75-e8e9-40b5-97df-f18b868d3b5f from snapshot d052fd2e-8c31-42f4-9241-fcde50ce035f {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-quobyte-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:57 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-bd6ff406-3d2d-4830-adcd-a1f2487d45cf tempest-CreateVolumesFromSnapshotTest-1901461355 None] Create snapshot completed successfully Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] snapshot: d052fd2e-8c31-42f4-9241-fcde50ce035f, volume: d08a9a75-e8e9-40b5-97df-f18b868d3b5f, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1035648b-ff09-40c0-82b1-0255eba3da57]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "cinder-4548952f-b133-4633-af2a-b483172f7822-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:57 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f Apr 10 10:40:57 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-4548952f-b133-4633-af2a-b483172f7822-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "cinder-quobyte-4548952f-b133-4633-af2a-b483172f7822" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-quobyte-4548952f-b133-4633-af2a-b483172f7822" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ba70fc-3871-4fe9-aff7-78370b79eb8e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:57 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822 Apr 10 10:40:57 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:57 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:40:57 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:58 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f" returned: 0 in 0.872s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3156fa-a64b-4343-946a-c49b9fded3fa]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:58 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e Apr 10 10:40:58 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:58 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822" returned: 0 in 0.954s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:58 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822 Apr 10 10:40:58 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:58 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.937s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (3aef1de6-2753-4ae7-b51a-3117e02cb62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52c74ff-d3d3-4ee8-a7ec-ddfadba42f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52c74ff-d3d3-4ee8-a7ec-ddfadba42f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741286499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d4ada8-3e5b-49a3-8a57-a8265f9172d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:59Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a0652b-99c2-4732-bdc3-81ad159fa614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a0652b-99c2-4732-bdc3-81ad159fa614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4daedbb-6a66-43a0-991c-1332b79360d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4daedbb-6a66-43a0-991c-1332b79360d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d4ada8-3e5b-49a3-8a57-a8265f9172d7', 'volume_name': 'volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f70a90-5951-4484-9fb6-080f7ed23769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f70a90-5951-4484-9fb6-080f7ed23769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd4c1d0-d787-4362-9036-454b63f5d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:58 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume 40d4ada8-3e5b-49a3-8a57-a8265f9172d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7', 'volume_size': 1} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Flow 'volume_create_manager' (6b483a6d-d145-4896-8856-c1a5cb1bf8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6aa9212-906a-4d8d-9622-6f720c2261ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6aa9212-906a-4d8d-9622-6f720c2261ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-602651905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79495af2-00c7-41bf-a308-b5fc9fb545f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e88afa993a48b4a6f1d8cc673c1876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:59Z,use_quota=True,user_id='15284fd544b84edb9aa4be0d32439177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127600fe-2ba4-4985-8c1d-da6d6ed18703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127600fe-2ba4-4985-8c1d-da6d6ed18703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac0deca-3ab3-4b39-8670-55b584393c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac0deca-3ab3-4b39-8670-55b584393c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79495af2-00c7-41bf-a308-b5fc9fb545f4', 'volume_name': 'volume-79495af2-00c7-41bf-a308-b5fc9fb545f4', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01758097-8014-4469-9c3d-575baf2da062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01758097-8014-4469-9c3d-575baf2da062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b56cb98-e2b1-40b9-beeb-92307218f691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:58 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Volume 79495af2-00c7-41bf-a308-b5fc9fb545f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79495af2-00c7-41bf-a308-b5fc9fb545f4', 'volume_size': 1} Apr 10 10:40:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (5d4676ab-6852-445f-b2de-bb8d0e0c5622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c40669-2c4a-4aae-84a3-4c5e4ca14960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c40669-2c4a-4aae-84a3-4c5e4ca14960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-103001752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8240f0fa-87f0-4915-82fe-b38454a738de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:59Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0a7dac-0347-465f-ae38-ef5b4fdc56fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0a7dac-0347-465f-ae38-ef5b4fdc56fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c84c5d3-3c59-407c-8eef-6dab99b859ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c84c5d3-3c59-407c-8eef-6dab99b859ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8240f0fa-87f0-4915-82fe-b38454a738de', 'volume_name': 'volume-8240f0fa-87f0-4915-82fe-b38454a738de', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e71713e-171d-4d8f-95c5-46935a6cd2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e71713e-171d-4d8f-95c5-46935a6cd2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a1b342-452f-4bfc-b976-8e9deeb97a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume 8240f0fa-87f0-4915-82fe-b38454a738de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8240f0fa-87f0-4915-82fe-b38454a738de', 'volume_size': 1} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" returned: 0 in 1.010s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:59 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f Apr 10 10:40:59 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:59 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-4548952f-b133-4633-af2a-b483172f7822" returned: 0 in 0.769s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-quobyte-4548952f-b133-4633-af2a-b483172f7822" released by "delete_volume" :: held 1.757s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Created reservations ['0538ca05-c5e3-45fe-b303-604069fb16e6', '1d3b7d50-9ed3-4183-9fad-087b16b8469a', 'fbf480a8-790b-4ecb-b44f-455b1a71e6d9', 'b4d3b452-a8d3-4f41-91cd-f2a9307477e7'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:59 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:40:59 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (569276ea-9c6a-4d47-a153-600f2d522c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3760d007-57e2-4b14-87d1-cca3bb4726b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3760d007-57e2-4b14-87d1-cca3bb4726b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-409794016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5bbaac-c6ff-4189-945a-8f889ed1a189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:59Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60caed39-777b-441d-bc1f-ead848646829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60caed39-777b-441d-bc1f-ead848646829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23279c9-bddb-4257-8f6b-1b433aa9fd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23279c9-bddb-4257-8f6b-1b433aa9fd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f5bbaac-c6ff-4189-945a-8f889ed1a189', 'volume_name': 'volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b1f227-b3b9-44aa-9c3f-04f034c8b035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b1f227-b3b9-44aa-9c3f-04f034c8b035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e226be49-82cb-431e-9ff2-b0a74b339e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume 5f5bbaac-c6ff-4189-945a-8f889ed1a189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189', 'volume_size': 1} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (c1acf279-e371-4f42-aa1b-8f27687fad90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f15c4e2-d26f-4309-a320-94d6d637253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f15c4e2-d26f-4309-a320-94d6d637253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-157027298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521d2fb8-558b-494b-b2ff-53dcbe39ae2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:00Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4301ae-0bc3-42dc-a12e-7a131b7d8c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4301ae-0bc3-42dc-a12e-7a131b7d8c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d118217e-a1f1-4b64-932b-667997842e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d118217e-a1f1-4b64-932b-667997842e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '521d2fb8-558b-494b-b2ff-53dcbe39ae2f', 'volume_name': 'volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2a319e-41f2-4165-8ed8-57faac92b7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2a319e-41f2-4165-8ed8-57faac92b7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d8f3bd-4266-4908-96fc-e46bf9306220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:59 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume 521d2fb8-558b-494b-b2ff-53dcbe39ae2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f', 'volume_size': 1} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "cinder-a4af3e1d-d8fc-4005-8920-be38cecb0dc4-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:59 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-a4af3e1d-d8fc-4005-8920-be38cecb0dc4-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "cinder-quobyte-a4af3e1d-d8fc-4005-8920-be38cecb0dc4" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-quobyte-a4af3e1d-d8fc-4005-8920-be38cecb0dc4" acquired by "delete_volume" :: waited 0.028s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[6687b4df-0874-4cd6-8301-16ae1071ba5f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:00 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 1.106s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (edd7d2a6-063f-4c1b-b9d6-2ad30a0428bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d0f6b0-efca-4549-9af2-8200dec2ff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:00 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Deleted volume successfully. Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d0f6b0-efca-4549-9af2-8200dec2ff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34174543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21cf575-b49d-4115-84fb-b9481a63ad0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:00Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:00 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4 Apr 10 10:41:00 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3d1af9-76ae-4347-8623-477051d2d581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3d1af9-76ae-4347-8623-477051d2d581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c946e86-11a2-4021-a127-0b71454b9032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c946e86-11a2-4021-a127-0b71454b9032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd21cf575-b49d-4115-84fb-b9481a63ad0a', 'volume_name': 'volume-d21cf575-b49d-4115-84fb-b9481a63ad0a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffbd221-24c9-46d5-9797-c868387a0dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffbd221-24c9-46d5-9797-c868387a0dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7df149-c85b-4205-b09b-ea648e2d15f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:00 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume d21cf575-b49d-4115-84fb-b9481a63ad0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d21cf575-b49d-4115-84fb-b9481a63ad0a', 'volume_size': 1} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:00 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-57050af3-37c5-49f5-9523-e767134385f5 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-4548952f-b133-4633-af2a-b483172f7822-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:01 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4" returned: 0 in 1.137s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:01 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4 Apr 10 10:41:01 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:01 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" returned: 0 in 2.690s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:01 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[81498dd5-fd5e-4b12-9b45-cb92de9a65db]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:01 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:01 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e Apr 10 10:41:01 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:02 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a4af3e1d-d8fc-4005-8920-be38cecb0dc4" returned: 0 in 0.628s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-quobyte-a4af3e1d-d8fc-4005-8920-be38cecb0dc4" released by "delete_volume" :: held 2.027s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Created reservations ['8c7120a3-5056-42ed-afca-93f12e5fec19', '9c25681e-b8f9-4b1e-a458-8ee99e195072', 'd4673f53-8cb9-4ea0-82c7-8a3f538da44c', '1ca8805e-78fc-47ba-bd9c-605ddbcbe27d'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:02 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:02 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:02 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" returned: 0 in 0.710s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e, size 1024.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:41:02 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Converted 1024.00 MB image at 380.53 MB/s Apr 10 10:41:02 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f is being set with open permissions: ugo+rw Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:02 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f Apr 10 10:41:02 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:02 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.469s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:02 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Deleted volume successfully. Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-0cd00536-f68c-4e9d-bc7c-5319b2e7ead9 tempest-CreateVolumesFromImageTest-1240536497 None] Lock "cinder-a4af3e1d-d8fc-4005-8920-be38cecb0dc4-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:02 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:02 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" returned: 0 in 0.475s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" released by "_copy_volume_from_snapshot" :: held 5.825s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-d052fd2e-8c31-42f4-9241-fcde50ce035f-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" released by "_create_volume_from_snapshot" :: held 5.850s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.873s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.287s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741286499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d4ada8-3e5b-49a3-8a57-a8265f9172d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:59Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Creating volume 40d4ada8-3e5b-49a3-8a57-a8265f9172d7 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:03 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:03 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7 1073741824 Apr 10 10:41:03 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5d2464-db01-42c9-9bdb-eeef75cf9980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f', 'volume_size': 1, 'snapshot_id': 'd052fd2e-8c31-42f4-9241-fcde50ce035f'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee13c44-48ed-4577-a397-7d58a443de31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:03 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Volume volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f (d08a9a75-e8e9-40b5-97df-f18b868d3b5f): created successfully Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee13c44-48ed-4577-a397-7d58a443de31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Flow 'volume_create_manager' (7ea65ee4-f268-42f7-adf5-11553afec716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:03 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-785ce1ec-e538-43f5-8dcc-a1ff0e3d4c30 tempest-VolumeDependencyTests-613899977 None] Created volume successfully. Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-d052fd2e-8c31-42f4-9241-fcde50ce035f-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Lock "cinder-d052fd2e-8c31-42f4-9241-fcde50ce035f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-quobyte-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-quobyte-d052fd2e-8c31-42f4-9241-fcde50ce035f" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-d052fd2e-8c31-42f4-9241-fcde50ce035f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Deleting offline snapshot d052fd2e-8c31-42f4-9241-fcde50ce035f of volume 36c22a99-49a7-4eb4-bf27-e473cef5ce4e {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] snapshot_file for this snap is: volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ee25ec-f280-4226-b7de-a89569dfe812]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:03 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f Apr 10 10:41:03 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:03 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7 1073741824" returned: 0 in 0.772s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:03 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7 Apr 10 10:41:03 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:03 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:03 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f" returned: 0 in 0.661s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12ff40a-8378-4c92-b36b-44855dd82c72]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:04 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e Apr 10 10:41:04 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:04 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7" returned: 0 in 0.675s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.532s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-602651905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79495af2-00c7-41bf-a308-b5fc9fb545f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e88afa993a48b4a6f1d8cc673c1876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:59Z,use_quota=True,user_id='15284fd544b84edb9aa4be0d32439177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Creating volume 79495af2-00c7-41bf-a308-b5fc9fb545f4 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:04 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd4c1d0-d787-4362-9036-454b63f5d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:04 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 1073741824 Apr 10 10:41:04 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5a1a01-692f-4e27-9de4-7a3d50474b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:04 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7 (40d4ada8-3e5b-49a3-8a57-a8265f9172d7): created successfully Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5a1a01-692f-4e27-9de4-7a3d50474b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (3aef1de6-2753-4ae7-b51a-3117e02cb62d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:04 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-05c834d8-c2fc-45f4-9f35-090c5f6e9d0d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created volume successfully. Apr 10 10:41:04 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" returned: 0 in 0.807s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:04 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:04 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f Apr 10 10:41:04 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:05 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 1073741824" returned: 0 in 0.926s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:05 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 Apr 10 10:41:05 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:05 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f" returned: 0 in 0.771s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:05 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f Apr 10 10:41:05 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:05 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4" returned: 0 in 0.502s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:05 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:05 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.896s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-103001752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8240f0fa-87f0-4915-82fe-b38454a738de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:59Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Creating volume 8240f0fa-87f0-4915-82fe-b38454a738de {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:06 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b56cb98-e2b1-40b9-beeb-92307218f691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79495af2-00c7-41bf-a308-b5fc9fb545f4', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:06 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de 1073741824 Apr 10 10:41:06 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73c539d-63a7-4b60-832f-9f4aa51fd628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (23441dbf-cbe6-47f3-897b-b4035143d82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d96c5d-9ee1-43aa-9c0d-66d4687b220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d96c5d-9ee1-43aa-9c0d-66d4687b220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-512889255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b9de6d-22e5-466d-8713-846d70e246c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:06Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d416eda-1036-44eb-b240-fd657e350299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d416eda-1036-44eb-b240-fd657e350299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926f2be6-f9d4-40ec-9249-c639c712c2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926f2be6-f9d4-40ec-9249-c639c712c2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86b9de6d-22e5-466d-8713-846d70e246c2', 'volume_name': 'volume-86b9de6d-22e5-466d-8713-846d70e246c2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:06 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641841ec-ec6d-417d-9839-2056d3b0cbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641841ec-ec6d-417d-9839-2056d3b0cbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2951e6a0-31be-4d3b-a90b-17372873ea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume 86b9de6d-22e5-466d-8713-846d70e246c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86b9de6d-22e5-466d-8713-846d70e246c2', 'volume_size': 1} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e.d052fd2e-8c31-42f4-9241-fcde50ce035f" returned: 0 in 0.513s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:06 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Volume volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 (79495af2-00c7-41bf-a308-b5fc9fb545f4): created successfully Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73c539d-63a7-4b60-832f-9f4aa51fd628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Flow 'volume_create_manager' (6b483a6d-d145-4896-8856-c1a5cb1bf8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b811cade-ccc1-41dc-afa8-dbd685497708 tempest-SnapshotDependencyTests-2088693929 None] Created volume successfully. Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-d052fd2e-8c31-42f4-9241-fcde50ce035f" released by "_delete_snapshot" :: held 2.837s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" released by "delete_snapshot" :: held 2.857s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Created reservations ['271c2a5e-30db-4e97-8936-22a5b256311f', '50c2f94c-b0c0-42dd-964b-d563f65c53fe', 'f4829bc8-a135-4ed4-8314-09f89858e3b6', 'dd385420-9a5f-4666-878e-17aaa778d6cf'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:06 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Delete snapshot completed successfully. Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-f19d6cb6-5a80-4849-863c-f43635babb7e tempest-VolumeDependencyTests-613899977 None] Lock "cinder-d052fd2e-8c31-42f4-9241-fcde50ce035f-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-36c22a99-49a7-4eb4-bf27-e473cef5ce4e-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-36c22a99-49a7-4eb4-bf27-e473cef5ce4e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-quobyte-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:06 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" acquired by "delete_volume" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de 1073741824" returned: 0 in 0.641s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b906733-eeda-410f-ae63-6ffdcaf7ca7a]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:06 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de Apr 10 10:41:06 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:06 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e Apr 10 10:41:06 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:06 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:07 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" returned: 0 in 0.515s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:07 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e Apr 10 10:41:07 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:07 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de" returned: 0 in 0.508s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.784s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-409794016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5bbaac-c6ff-4189-945a-8f889ed1a189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:59Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Creating volume 5f5bbaac-c6ff-4189-945a-8f889ed1a189 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:07 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a1b342-452f-4bfc-b976-8e9deeb97a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8240f0fa-87f0-4915-82fe-b38454a738de', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec5dc27-6632-44d7-8fd4-56bce77ba9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:07 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189 1073741824 Apr 10 10:41:07 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:07 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume volume-8240f0fa-87f0-4915-82fe-b38454a738de (8240f0fa-87f0-4915-82fe-b38454a738de): created successfully Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec5dc27-6632-44d7-8fd4-56bce77ba9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (5d4676ab-6852-445f-b2de-bb8d0e0c5622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:07 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-f78ffc59-3f99-4191-af6f-850a4f502475 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created volume successfully. Apr 10 10:41:07 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" returned: 0 in 0.507s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-36c22a99-49a7-4eb4-bf27-e473cef5ce4e" released by "delete_volume" :: held 1.060s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Created reservations ['83cf0a66-0335-4ce6-a6bd-aec173cf548b', '3b4bca76-19c2-4e1d-bf7f-86982e3a6ecb', '70fd3b30-9eab-4d96-86ca-a738cedc4ae6', '6adfdb41-7af2-460a-87da-89d456942c4f'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:07 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189 1073741824" returned: 0 in 0.586s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:07 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:07 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:07 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:07 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189 Apr 10 10:41:07 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:08 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.468s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Deleted volume successfully. Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-88b0c6e9-d83d-4239-9bc2-2880a14c4746 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-36c22a99-49a7-4eb4-bf27-e473cef5ce4e-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:08 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189" returned: 0 in 0.471s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.583s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-157027298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521d2fb8-558b-494b-b2ff-53dcbe39ae2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:00Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Creating volume 521d2fb8-558b-494b-b2ff-53dcbe39ae2f {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:08 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e226be49-82cb-431e-9ff2-b0a74b339e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab00c71-2d37-47ed-8037-cf1479d83646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:08 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f 1073741824 Apr 10 10:41:08 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:08 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189 (5f5bbaac-c6ff-4189-945a-8f889ed1a189): created successfully Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab00c71-2d37-47ed-8037-cf1479d83646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:08 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (569276ea-9c6a-4d47-a153-600f2d522c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:08 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-56a36b87-c537-4f5a-996d-df2e22093e96 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created volume successfully. Apr 10 10:41:09 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f 1073741824" returned: 0 in 0.667s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:09 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f Apr 10 10:41:09 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Flow 'volume_create_manager' (04609693-e109-458f-b8bd-d4e69f8fde6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ff0cab-aba4-4b4e-a61a-ae63c28971f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ff0cab-aba4-4b4e-a61a-ae63c28971f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-318277613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c039062-9d96-45bb-a9ea-6a607febb900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd148d28cdd64942a2f832a1553e45ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:09Z,use_quota=True,user_id='9c8f1afb34bf47dea150f48623235fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d02ca2-d31b-4109-851a-d736b61107aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d02ca2-d31b-4109-851a-d736b61107aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4d42e0-f150-4b0e-976b-a5a56b9102d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4d42e0-f150-4b0e-976b-a5a56b9102d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c039062-9d96-45bb-a9ea-6a607febb900', 'volume_name': 'volume-7c039062-9d96-45bb-a9ea-6a607febb900', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffe3e0d-4d95-4246-9312-3c065cd0d0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffe3e0d-4d95-4246-9312-3c065cd0d0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979d739b-2442-4812-a651-9ff8b5eed195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Volume 7c039062-9d96-45bb-a9ea-6a607febb900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c039062-9d96-45bb-a9ea-6a607febb900', 'volume_size': 1} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:09 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f" returned: 0 in 0.423s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.860s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34174543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21cf575-b49d-4115-84fb-b9481a63ad0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309b42bbf5f8400b9553d6c15c9f9da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:00Z,use_quota=True,user_id='b856a79907d6443bb66b454b494d7087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Creating volume d21cf575-b49d-4115-84fb-b9481a63ad0a {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:09 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:09 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a 1073741824 Apr 10 10:41:09 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d8f3bd-4266-4908-96fc-e46bf9306220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f32b969-1af2-4e5e-bd7c-0eecef0e1f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:09 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f (521d2fb8-558b-494b-b2ff-53dcbe39ae2f): created successfully Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f32b969-1af2-4e5e-bd7c-0eecef0e1f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:09 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (c1acf279-e371-4f42-aa1b-8f27687fad90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:09 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-662c4ce9-3d29-4087-82e1-179185e31fd1 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created volume successfully. Apr 10 10:41:10 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a 1073741824" returned: 0 in 0.542s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:10 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a Apr 10 10:41:10 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:10 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.471s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-512889255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b9de6d-22e5-466d-8713-846d70e246c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:06Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Creating volume 86b9de6d-22e5-466d-8713-846d70e246c2 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:10 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7df149-c85b-4205-b09b-ea648e2d15f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d21cf575-b49d-4115-84fb-b9481a63ad0a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b45bb6d-0125-45e3-a5e3-2ca0b735e35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:10 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2 1073741824 Apr 10 10:41:10 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:10 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Volume volume-d21cf575-b49d-4115-84fb-b9481a63ad0a (d21cf575-b49d-4115-84fb-b9481a63ad0a): created successfully Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b45bb6d-0125-45e3-a5e3-2ca0b735e35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Flow 'volume_create_manager' (edd7d2a6-063f-4c1b-b9d6-2ad30a0428bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:10 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a77828fe-8dba-4e68-a250-818a0867518d tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created volume successfully. Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-d21cf575-b49d-4115-84fb-b9481a63ad0a-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-d21cf575-b49d-4115-84fb-b9481a63ad0a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:10 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-quobyte-d21cf575-b49d-4115-84fb-b9481a63ad0a" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-d21cf575-b49d-4115-84fb-b9481a63ad0a" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe5225c-7ae6-4a31-a369-26b43b4d8c15]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:11 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a Apr 10 10:41:11 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:11 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2 1073741824" returned: 0 in 0.688s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:11 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2 Apr 10 10:41:11 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:11 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a" returned: 0 in 0.574s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:11 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a Apr 10 10:41:11 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:11 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2" returned: 0 in 0.487s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.988s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] Creating offline snapshot 921c175c-d652-49e6-80b0-2e682fee64b1 of volume 79495af2-00c7-41bf-a308-b5fc9fb545f4 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b276f7-248e-4fb1-a63e-6ccc0e85a60e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2951e6a0-31be-4d3b-a90b-17372873ea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86b9de6d-22e5-466d-8713-846d70e246c2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8402605-b065-4a40-a90a-baff7846ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:11 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume volume-86b9de6d-22e5-466d-8713-846d70e246c2 (86b9de6d-22e5-466d-8713-846d70e246c2): created successfully Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8402605-b065-4a40-a90a-baff7846ba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:11 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (23441dbf-cbe6-47f3-897b-b4035143d82b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:11 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c077fd1c-448f-4aab-85fc-f054e1eb625c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created volume successfully. Apr 10 10:41:11 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 Apr 10 10:41:11 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:12 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d21cf575-b49d-4115-84fb-b9481a63ad0a" returned: 0 in 0.480s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-d21cf575-b49d-4115-84fb-b9481a63ad0a" released by "delete_volume" :: held 1.092s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created reservations ['64a41bee-42ba-4073-8071-dcb7ebf8406f', '38edd382-1493-41fc-ba28-231fe0c78818', '1910fbf7-695d-418c-9a46-cace48012b18', 'e903f605-bb1d-497d-b987-264a351b882c'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:12 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:12 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:12 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4" returned: 0 in 0.622s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:12 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 1G Apr 10 10:41:12 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (201e547b-3829-49ab-877f-c6db1a8d9904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d4eeb1-2e3a-4210-9991-a7cafcf89ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d4eeb1-2e3a-4210-9991-a7cafcf89ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1166708549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946f6104-ec42-4aff-b242-62aeca4f40a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:13Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16ee29c-3693-431b-9001-3325cdb6e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16ee29c-3693-431b-9001-3325cdb6e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b7e010-6863-4db4-9e73-9f5fc30d95f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b7e010-6863-4db4-9e73-9f5fc30d95f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946f6104-ec42-4aff-b242-62aeca4f40a6', 'volume_name': 'volume-946f6104-ec42-4aff-b242-62aeca4f40a6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176af298-18b4-4a9e-b698-d3f8952d73ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176af298-18b4-4a9e-b698-d3f8952d73ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b272a1b9-3913-4732-8dc2-4f7de53359d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:12 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume 946f6104-ec42-4aff-b242-62aeca4f40a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946f6104-ec42-4aff-b242-62aeca4f40a6', 'volume_size': 1} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:12 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.576s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:12 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Deleted volume successfully. Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-3858dd39-71cd-4ad3-9028-9fc6cd751173 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-d21cf575-b49d-4115-84fb-b9481a63ad0a-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (b37777bd-e2d8-4b14-9cb0-3e7f188e806e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ac4d07-233d-45e9-ab0a-72ba64b798ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ac4d07-233d-45e9-ab0a-72ba64b798ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2021660320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262f1eb3-8823-44bc-9c07-aac7834ec86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:13Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0c474c-5a1e-4aaa-b349-ad7b05cc4c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0c474c-5a1e-4aaa-b349-ad7b05cc4c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b70143-6911-4edd-883a-896ff0a58ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b70143-6911-4edd-883a-896ff0a58ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '262f1eb3-8823-44bc-9c07-aac7834ec86a', 'volume_name': 'volume-262f1eb3-8823-44bc-9c07-aac7834ec86a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09e957f-824f-49cf-bbea-76f242e23c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b09e957f-824f-49cf-bbea-76f242e23c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca709bc-5658-4244-89a2-94914c9edf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:12 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume 262f1eb3-8823-44bc-9c07-aac7834ec86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-262f1eb3-8823-44bc-9c07-aac7834ec86a', 'volume_size': 1} Apr 10 10:41:12 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:13 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 1G" returned: 0 in 0.646s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:13 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 Apr 10 10:41:13 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-521d2fb8-558b-494b-b2ff-53dcbe39ae2f-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (6b856847-7f1b-4928-bd32-bee9d0b0ba92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ef4e34-844f-4af2-b905-280862921874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-521d2fb8-558b-494b-b2ff-53dcbe39ae2f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ef4e34-844f-4af2-b905-280862921874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375057857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e6d9fc-100c-4493-8d58-ebc9aaef095f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:13Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f39520-ac16-42cf-9290-a33301c9f688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f39520-ac16-42cf-9290-a33301c9f688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878173d9-4524-4253-8ce3-d293c65e8db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878173d9-4524-4253-8ce3-d293c65e8db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e6d9fc-100c-4493-8d58-ebc9aaef095f', 'volume_name': 'volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a8404f-d52e-4c6b-b0f3-b68dbcbb6eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a8404f-d52e-4c6b-b0f3-b68dbcbb6eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c47131b-09c2-4dd7-b6c0-9026fd22affd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:13 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume a0e6d9fc-100c-4493-8d58-ebc9aaef095f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f', 'volume_size': 1} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-quobyte-521d2fb8-558b-494b-b2ff-53dcbe39ae2f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-521d2fb8-558b-494b-b2ff-53dcbe39ae2f" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa4cfc3-0aff-4ac7-a0d3-58eb28ef40a2]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:13 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f Apr 10 10:41:13 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:13 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1" returned: 0 in 0.554s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:13 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 is being set with open permissions: ugo+rw Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:13 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 Apr 10 10:41:13 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (3e3eac1d-e3b5-4bd9-8b1b-f2f7e163fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f891e2-e145-45f6-929c-1cfd769c507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f891e2-e145-45f6-929c-1cfd769c507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1359791030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a34f90-972d-48c3-9756-566ebe531f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:13Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5831a38a-ac54-4dbb-a044-0ccb434372fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5831a38a-ac54-4dbb-a044-0ccb434372fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08220d9-75dd-44c8-904d-1ae011f1c31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08220d9-75dd-44c8-904d-1ae011f1c31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a34f90-972d-48c3-9756-566ebe531f73', 'volume_name': 'volume-e1a34f90-972d-48c3-9756-566ebe531f73', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e86bab-c496-4b46-beb2-c154525b72de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e86bab-c496-4b46-beb2-c154525b72de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6762f6d5-795b-4795-b095-ae95b4428c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:13 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume e1a34f90-972d-48c3-9756-566ebe531f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a34f90-972d-48c3-9756-566ebe531f73', 'volume_size': 1} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:13 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f" returned: 0 in 0.556s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:13 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:13 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f Apr 10 10:41:13 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (d54d5842-e3db-45f8-a588-620fb272a2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411edf38-687d-4d32-9926-113df82ac87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411edf38-687d-4d32-9926-113df82ac87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-124301559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c99b642-ca6e-4763-88ba-bda5281c2e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:14Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f8f0f9-cc1d-4bb0-9464-58d2c9771888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f8f0f9-cc1d-4bb0-9464-58d2c9771888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cd0620-6e87-420c-a3d7-02ebdc2e1415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cd0620-6e87-420c-a3d7-02ebdc2e1415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c99b642-ca6e-4763-88ba-bda5281c2e05', 'volume_name': 'volume-1c99b642-ca6e-4763-88ba-bda5281c2e05', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfc74b1-e64c-4f0e-9c3b-d08a9c7c94ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfc74b1-e64c-4f0e-9c3b-d08a9c7c94ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed30472a-75ee-4d3d-a734-eb69b0f2bbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:14 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume 1c99b642-ca6e-4763-88ba-bda5281c2e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c99b642-ca6e-4763-88ba-bda5281c2e05', 'volume_size': 1} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:14 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1" returned: 0 in 0.542s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:14 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.info Apr 10 10:41:14 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:14 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-521d2fb8-558b-494b-b2ff-53dcbe39ae2f" returned: 0 in 0.451s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-521d2fb8-558b-494b-b2ff-53dcbe39ae2f" released by "delete_volume" :: held 1.038s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created reservations ['c7972ec1-ae55-4f4d-a00d-9360697d2598', 'c7689c33-9126-48b8-b723-71714916a0b2', '3272e1a0-4f33-4ecf-b88d-21d80054e64f', '9d7a3ba7-5711-408d-be9a-ac477d7efd58'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:14 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:14 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:14 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.info" returned: 0 in 0.477s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:14 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.info is being set with open permissions: ugo+rw Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:14 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.info Apr 10 10:41:14 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:14 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.401s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:14 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Deleted volume successfully. Apr 10 10:41:14 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-29e01783-853a-445e-9fc6-5ae30c26029c tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-521d2fb8-558b-494b-b2ff-53dcbe39ae2f-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:15 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.info" returned: 0 in 0.442s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.342s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.928s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-318277613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c039062-9d96-45bb-a9ea-6a607febb900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd148d28cdd64942a2f832a1553e45ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:09Z,use_quota=True,user_id='9c8f1afb34bf47dea150f48623235fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Creating volume 7c039062-9d96-45bb-a9ea-6a607febb900 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:15 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:15 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 1073741824 Apr 10 10:41:15 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:15 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-67eeac31-b475-46a6-8343-3fe85b5ecadb tempest-SnapshotDependencyTests-2088693929 None] Create snapshot completed successfully Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-5f5bbaac-c6ff-4189-945a-8f889ed1a189-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-5f5bbaac-c6ff-4189-945a-8f889ed1a189-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-quobyte-5f5bbaac-c6ff-4189-945a-8f889ed1a189" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-5f5bbaac-c6ff-4189-945a-8f889ed1a189" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[db853eba-f0ee-43b1-9ca1-162f1d56e141]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:15 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189 Apr 10 10:41:15 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:15 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 1073741824" returned: 0 in 0.547s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:15 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 Apr 10 10:41:15 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:15 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189" returned: 0 in 0.518s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:15 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:16 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189 Apr 10 10:41:16 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:16 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900" returned: 0 in 0.509s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.540s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1166708549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946f6104-ec42-4aff-b242-62aeca4f40a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:13Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Creating volume 946f6104-ec42-4aff-b242-62aeca4f40a6 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:16 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979d739b-2442-4812-a651-9ff8b5eed195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c039062-9d96-45bb-a9ea-6a607febb900', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acd0e10-1077-4bc3-b0ab-855101855b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:16 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6 1073741824 Apr 10 10:41:16 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:16 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Volume volume-7c039062-9d96-45bb-a9ea-6a607febb900 (7c039062-9d96-45bb-a9ea-6a607febb900): created successfully Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acd0e10-1077-4bc3-b0ab-855101855b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Flow 'volume_create_manager' (04609693-e109-458f-b8bd-d4e69f8fde6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:16 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b81f995b-c432-436d-82bf-0de9bc4415b5 tempest-VolumeDependencyTests-613899977 None] Created volume successfully. Apr 10 10:41:16 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-5f5bbaac-c6ff-4189-945a-8f889ed1a189" returned: 0 in 0.483s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-5f5bbaac-c6ff-4189-945a-8f889ed1a189" released by "delete_volume" :: held 1.023s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created reservations ['99410d4a-1660-4555-8df7-8a14a01044b1', '82635145-63a3-4b2e-86f5-da3a4cf58b11', '3b99f043-9a28-4a56-a7de-83750d12db26', '08654b43-768b-4474-badf-ce4b973c5292'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Flow 'volume_create_manager' (1a65b412-acd8-4cc4-adfe-42fd2947b78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e683f53-8608-4477-a106-5b8bc27a989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e683f53-8608-4477-a106-5b8bc27a989b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463ae8e3-cd25-4b3d-8e03-648058cfe1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e88afa993a48b4a6f1d8cc673c1876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=921c175c-d652-49e6-80b0-2e682fee64b1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:17Z,use_quota=True,user_id='15284fd544b84edb9aa4be0d32439177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34aef8e-148b-4f7a-8ef3-5857d66c43ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34aef8e-148b-4f7a-8ef3-5857d66c43ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83813335-07d0-44d1-9e04-538f7384cca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83813335-07d0-44d1-9e04-538f7384cca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '463ae8e3-cd25-4b3d-8e03-648058cfe1ed', 'volume_name': 'volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed', 'volume_size': 1, 'snapshot_id': '921c175c-d652-49e6-80b0-2e682fee64b1'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc9c5ec-16a0-4a2b-8e21-f32405a616eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc9c5ec-16a0-4a2b-8e21-f32405a616eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f09b448-a287-43a6-a7dd-edbbe8b524a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:16 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Volume 463ae8e3-cd25-4b3d-8e03-648058cfe1ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed', 'volume_size': 1, 'snapshot_id': '921c175c-d652-49e6-80b0-2e682fee64b1'} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:16 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:16 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:16 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Flow 'volume_create_manager' (9a530ce6-02a3-45db-a99a-44fae7a8aa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec444ba1-cfed-44d6-8f3b-3f41187eb49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec444ba1-cfed-44d6-8f3b-3f41187eb49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2008223350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5fb2749-ef54-4a04-9a1b-126b72f6aa49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd148d28cdd64942a2f832a1553e45ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7c039062-9d96-45bb-a9ea-6a607febb900,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:17Z,use_quota=True,user_id='9c8f1afb34bf47dea150f48623235fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70df313-11f6-4b59-8528-af18421ae1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70df313-11f6-4b59-8528-af18421ae1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e30d5d2-81dc-4b62-ab48-e0dae7299a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6 1073741824" returned: 0 in 0.724s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e30d5d2-81dc-4b62-ab48-e0dae7299a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f5fb2749-ef54-4a04-9a1b-126b72f6aa49', 'volume_name': 'volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49', 'volume_size': 1, 'source_volid': '7c039062-9d96-45bb-a9ea-6a607febb900', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad22ec76-c606-4fd5-a270-6e0d62c3eb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad22ec76-c606-4fd5-a270-6e0d62c3eb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:16 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f84f8f-e436-493a-9c41-08560893a59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:17 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Volume f5fb2749-ef54-4a04-9a1b-126b72f6aa49: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49', 'volume_size': 1, 'source_volid': '7c039062-9d96-45bb-a9ea-6a607febb900', 'source_volstatus': 'available'} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:17 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6 Apr 10 10:41:17 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:17 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.475s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Deleted volume successfully. Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-69681f26-98f7-486e-815b-b70a83d9e683 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-5f5bbaac-c6ff-4189-945a-8f889ed1a189-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:17 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6" returned: 0 in 0.425s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.457s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2021660320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262f1eb3-8823-44bc-9c07-aac7834ec86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:13Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Creating volume 262f1eb3-8823-44bc-9c07-aac7834ec86a {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:17 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b272a1b9-3913-4732-8dc2-4f7de53359d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946f6104-ec42-4aff-b242-62aeca4f40a6', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:17 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a 1073741824 Apr 10 10:41:17 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df94a2db-5aff-4fd3-9b9b-566c0c812b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:17 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume volume-946f6104-ec42-4aff-b242-62aeca4f40a6 (946f6104-ec42-4aff-b242-62aeca4f40a6): created successfully Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df94a2db-5aff-4fd3-9b9b-566c0c812b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (201e547b-3829-49ab-877f-c6db1a8d9904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:17 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-4db985a9-d8d6-49db-a3e4-bca89edd96f3 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created volume successfully. Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-8240f0fa-87f0-4915-82fe-b38454a738de-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-8240f0fa-87f0-4915-82fe-b38454a738de-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-quobyte-8240f0fa-87f0-4915-82fe-b38454a738de" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-8240f0fa-87f0-4915-82fe-b38454a738de" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8571ec-651d-49ef-be32-d5c637b44344]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:17 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de Apr 10 10:41:17 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:17 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a 1073741824" returned: 0 in 0.506s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:17 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:18 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a Apr 10 10:41:18 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:18 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de" returned: 0 in 0.505s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:18 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de Apr 10 10:41:18 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:18 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a" returned: 0 in 0.407s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.140s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375057857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e6d9fc-100c-4493-8d58-ebc9aaef095f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:13Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Creating volume a0e6d9fc-100c-4493-8d58-ebc9aaef095f {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:18 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca709bc-5658-4244-89a2-94914c9edf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-262f1eb3-8823-44bc-9c07-aac7834ec86a', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5b6787-28de-4385-ab4c-e4607c69f561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:18 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f 1073741824 Apr 10 10:41:18 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:18 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume volume-262f1eb3-8823-44bc-9c07-aac7834ec86a (262f1eb3-8823-44bc-9c07-aac7834ec86a): created successfully Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5b6787-28de-4385-ab4c-e4607c69f561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (b37777bd-e2d8-4b14-9cb0-3e7f188e806e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:18 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a435606f-cd9f-43f4-9aee-ab490f455d58 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created volume successfully. Apr 10 10:41:18 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-8240f0fa-87f0-4915-82fe-b38454a738de" returned: 0 in 0.487s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-8240f0fa-87f0-4915-82fe-b38454a738de" released by "delete_volume" :: held 1.013s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created reservations ['1b76f126-f0d3-4be3-af57-81b60ba5b830', '04563a0c-9938-4306-a5f6-703ac4082f82', 'ac724d67-1dbe-4d85-8cc9-0dbe9adbe0a5', 'f893e211-46d8-4508-8208-b8d2944347b5'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:18 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:18 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:18 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f 1073741824" returned: 0 in 0.518s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:18 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:18 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f Apr 10 10:41:18 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:19 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.501s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Deleted volume successfully. Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-9cd40218-69cc-41f8-8b30-9e9984c3863a tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-8240f0fa-87f0-4915-82fe-b38454a738de-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:19 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f" returned: 0 in 0.436s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.633s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1359791030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a34f90-972d-48c3-9756-566ebe531f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:13Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Creating volume e1a34f90-972d-48c3-9756-566ebe531f73 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:19 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c47131b-09c2-4dd7-b6c0-9026fd22affd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:19 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73 1073741824 Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aeece4-3c2d-4103-bd5a-958649583334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:19 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:19 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f (a0e6d9fc-100c-4493-8d58-ebc9aaef095f): created successfully Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aeece4-3c2d-4103-bd5a-958649583334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (6b856847-7f1b-4928-bd32-bee9d0b0ba92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:19 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a68344d1-38a2-4fca-a638-7bafdb5a89ae tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created volume successfully. Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-40d4ada8-3e5b-49a3-8a57-a8265f9172d7-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-40d4ada8-3e5b-49a3-8a57-a8265f9172d7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-quobyte-40d4ada8-3e5b-49a3-8a57-a8265f9172d7" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-40d4ada8-3e5b-49a3-8a57-a8265f9172d7" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb61feb-0044-4635-a79f-a1c8d9c7a749]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:19 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73 1073741824" returned: 0 in 0.548s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:19 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:19 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7 Apr 10 10:41:19 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:19 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73 Apr 10 10:41:19 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:20 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73" returned: 0 in 0.429s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:20 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.246s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-124301559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c99b642-ca6e-4763-88ba-bda5281c2e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2d2f263ee348619057591cb193ebae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:14Z,use_quota=True,user_id='7d2baf398cac475695b576b64eaf7cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Creating volume 1c99b642-ca6e-4763-88ba-bda5281c2e05 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:20 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7" returned: 0 in 0.539s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:20 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05 1073741824 Apr 10 10:41:20 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6762f6d5-795b-4795-b095-ae95b4428c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a34f90-972d-48c3-9756-566ebe531f73', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a95185-ad7b-4a1d-a619-af689107f258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:20 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7 Apr 10 10:41:20 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:20 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume volume-e1a34f90-972d-48c3-9756-566ebe531f73 (e1a34f90-972d-48c3-9756-566ebe531f73): created successfully Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a95185-ad7b-4a1d-a619-af689107f258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (3e3eac1d-e3b5-4bd9-8b1b-f2f7e163fd27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:20 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2acddd21-4469-4959-a4a6-c44eb89261c1 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created volume successfully. Apr 10 10:41:20 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-40d4ada8-3e5b-49a3-8a57-a8265f9172d7" returned: 0 in 0.449s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-40d4ada8-3e5b-49a3-8a57-a8265f9172d7" released by "delete_volume" :: held 1.018s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:20 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created reservations ['3785e3fe-eb00-4ce2-8939-b2860b981aa1', '60ecfac1-4863-40b5-b5c0-9bbf4114816a', '15702991-060c-427a-bdb7-d5e5b06d0abb', '62613311-98cb-41cf-a255-e96d773fae87'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05 1073741824" returned: 0 in 0.541s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:20 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:21 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05 Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:21 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:21 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:21 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:21 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05" returned: 0 in 0.432s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.702s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "cinder-quobyte-921c175c-d652-49e6-80b0-2e682fee64b1-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" by "_create_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed30472a-75ee-4d3d-a734-eb69b0f2bbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c99b642-ca6e-4763-88ba-bda5281c2e05', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a75b32-c7b2-4653-885c-04387f8c9272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:21 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Volume volume-1c99b642-ca6e-4763-88ba-bda5281c2e05 (1c99b642-ca6e-4763-88ba-bda5281c2e05): created successfully Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a75b32-c7b2-4653-885c-04387f8c9272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Flow 'volume_create_manager' (d54d5842-e3db-45f8-a588-620fb272a2d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-921c175c-d652-49e6-80b0-2e682fee64b1-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Creating volume 463ae8e3-cd25-4b3d-8e03-648058cfe1ed from snapshot 921c175c-d652-49e6-80b0-2e682fee64b1 {{(pid=83037) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "cinder-quobyte-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:21 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-101def63-cd68-4ad0-b92c-d4b87ef49968 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created volume successfully. Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.459s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] snapshot: 921c175c-d652-49e6-80b0-2e682fee64b1, volume: 463ae8e3-cd25-4b3d-8e03-648058cfe1ed, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:41:21 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Deleted volume successfully. Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8497d8ce-1afa-4c76-95e4-c7c7cde175bb tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-40d4ada8-3e5b-49a3-8a57-a8265f9172d7-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd925e7-7283-4ed8-a4c0-4826a1b533a3]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:21 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 Apr 10 10:41:21 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-1c99b642-ca6e-4763-88ba-bda5281c2e05-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-1c99b642-ca6e-4763-88ba-bda5281c2e05-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-quobyte-1c99b642-ca6e-4763-88ba-bda5281c2e05" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-1c99b642-ca6e-4763-88ba-bda5281c2e05" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[65deaa5c-6c08-4bfe-8319-36b20f81afbd]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:21 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:21 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05 Apr 10 10:41:21 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-8895a0cc-cec2-4a41-a045-2d4b2faf583d-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-8895a0cc-cec2-4a41-a045-2d4b2faf583d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-quobyte-2dd75232-a453-4426-b855-f3e0068ad1d6" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-2dd75232-a453-4426-b855-f3e0068ad1d6" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-quobyte-8895a0cc-cec2-4a41-a045-2d4b2faf583d" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-8895a0cc-cec2-4a41-a045-2d4b2faf583d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Deleting offline snapshot 8895a0cc-cec2-4a41-a045-2d4b2faf583d of volume 2dd75232-a453-4426-b855-f3e0068ad1d6 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] snapshot_file for this snap is: volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4533a63-f347-4a05-8754-ae07dd696134]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:22 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1" returned: 0 in 0.572s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79495af2-00c7-41bf-a308-b5fc9fb545f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fed151-3757-49b4-987d-ca0b6def5e62]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:22 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d Apr 10 10:41:22 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:22 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 Apr 10 10:41:22 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:22 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05" returned: 0 in 0.577s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:22 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05 Apr 10 10:41:22 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:22 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d" returned: 0 in 0.544s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2dd75232-a453-4426-b855-f3e0068ad1d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafa5d9c-1465-4f1d-91ed-c4dd6f9cfc30]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:22 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4" returned: 0 in 0.545s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:22 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed Apr 10 10:41:22 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:22 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 Apr 10 10:41:22 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:22 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-1c99b642-ca6e-4763-88ba-bda5281c2e05" returned: 0 in 0.464s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-1c99b642-ca6e-4763-88ba-bda5281c2e05" released by "delete_volume" :: held 1.062s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created reservations ['3fafc53f-b1fd-4930-bd4a-34deed0912dd', 'edb2e183-d29d-4b47-8bd5-ab360da36326', 'f26540d9-bde4-4304-8ac0-bbe349947d70', 'aeccdc86-5265-4635-bee8-12fce45a34eb'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:22 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:22 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:22 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:23 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6" returned: 0 in 0.692s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:23 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:23 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d Apr 10 10:41:23 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:23 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-e1a34f90-972d-48c3-9756-566ebe531f73-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-e1a34f90-972d-48c3-9756-566ebe531f73-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:24 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-quobyte-e1a34f90-972d-48c3-9756-566ebe531f73" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 1.298s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:24 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:24 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Deleted volume successfully. Apr 10 10:41:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-e1a34f90-972d-48c3-9756-566ebe531f73" acquired by "delete_volume" :: waited 0.120s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:24 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ec7a852c-1328-4357-aaca-76b88c13faf9 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-1c99b642-ca6e-4763-88ba-bda5281c2e05-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:24 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[1015949b-9df5-43fb-a65d-b7a7f11a1ff1]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:24 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73 Apr 10 10:41:24 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:24 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d" returned: 0 in 1.498s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:24 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:24 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d Apr 10 10:41:24 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:25 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" returned: 0 in 2.412s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b66754b-0275-4c4b-9c79-71acc56486e8]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:25 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 Apr 10 10:41:25 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:25 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73" returned: 0 in 0.943s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:25 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73 Apr 10 10:41:25 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:25 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6.8895a0cc-cec2-4a41-a045-2d4b2faf583d" returned: 0 in 0.572s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-8895a0cc-cec2-4a41-a045-2d4b2faf583d" released by "_delete_snapshot" :: held 3.374s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-2dd75232-a453-4426-b855-f3e0068ad1d6" released by "delete_snapshot" :: held 3.393s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created reservations ['4909e667-a1a0-477e-9a2a-c394857d4a67', '56fcbc7b-727f-4fdd-bf96-39efa8bbaffe', '285c4c3d-a8ab-4cbe-9e02-4b21c1d02493', 'ff78be79-ef4a-4982-b7c3-ff2e10e65012'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:25 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Delete snapshot completed successfully. Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-7c81f5d7-47ba-41f7-a224-2cbf828ed812 tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-8895a0cc-cec2-4a41-a045-2d4b2faf583d-delete_snapshot" released by "delete_snapshot" :: held 3.488s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:25 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-e1a34f90-972d-48c3-9756-566ebe531f73" returned: 0 in 0.446s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-e1a34f90-972d-48c3-9756-566ebe531f73" released by "delete_volume" :: held 1.441s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created reservations ['6cf9a8f9-53b8-437c-a96f-e440b208e968', 'f5669d0d-9d9f-4e19-b47a-8faa4d675539', '31da7a5e-b03d-42c1-8e7a-ba0b6d26f073', '39a262ba-2fe3-480c-9da7-e7ace1fc36e7'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:25 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4" returned: 0 in 0.667s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4, size 1024.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:41:25 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Converted 1024.00 MB image at 424.28 MB/s Apr 10 10:41:25 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed is being set with open permissions: ugo+rw Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:25 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed Apr 10 10:41:25 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:25 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:25 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:25 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:26 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" returned: 0 in 0.410s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" released by "_copy_volume_from_snapshot" :: held 4.686s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-921c175c-d652-49e6-80b0-2e682fee64b1-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" released by "_create_volume_from_snapshot" :: held 4.720s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.757s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.197s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:26 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Cloning volume 7c039062-9d96-45bb-a9ea-6a607febb900 to volume f5fb2749-ef54-4a04-9a1b-126b72f6aa49 Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-a0e6d9fc-100c-4493-8d58-ebc9aaef095f-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Creating offline snapshot 835a5bc7-f277-4909-b02d-26d108020528 of volume 7c039062-9d96-45bb-a9ea-6a607febb900 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-2dd75232-a453-4426-b855-f3e0068ad1d6-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:26 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd775ec0-d413-47db-9b8e-c435f4686d10]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f09b448-a287-43a6-a7dd-edbbe8b524a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed', 'volume_size': 1, 'snapshot_id': '921c175c-d652-49e6-80b0-2e682fee64b1'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c333be-aa88-4bf5-8d7f-61b4a3c4d218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.530s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-a0e6d9fc-100c-4493-8d58-ebc9aaef095f-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-2dd75232-a453-4426-b855-f3e0068ad1d6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:26 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Volume volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed (463ae8e3-cd25-4b3d-8e03-648058cfe1ed): created successfully Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c333be-aa88-4bf5-8d7f-61b4a3c4d218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Flow 'volume_create_manager' (1a65b412-acd8-4cc4-adfe-42fd2947b78b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Deleted volume successfully. Apr 10 10:41:26 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-feac6064-6bc0-42a7-977e-4ec648027777 tempest-SnapshotDependencyTests-2088693929 None] Created volume successfully. Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-c73fa8f6-d48e-4ccf-9092-6baf02da01fc tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-e1a34f90-972d-48c3-9756-566ebe531f73-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-quobyte-a0e6d9fc-100c-4493-8d58-ebc9aaef095f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "cinder-quobyte-2dd75232-a453-4426-b855-f3e0068ad1d6" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-a0e6d9fc-100c-4493-8d58-ebc9aaef095f" acquired by "delete_volume" :: waited 0.020s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:26 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 Apr 10 10:41:26 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda36d7-2162-4919-b734-409a7c61493e]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-2dd75232-a453-4426-b855-f3e0068ad1d6" acquired by "delete_volume" :: waited 0.029s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e994da20-c30f-4968-9d81-b3aa9c1e17b3]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:26 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f Apr 10 10:41:26 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:26 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 Apr 10 10:41:26 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:26 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900" returned: 0 in 0.522s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:26 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 1G Apr 10 10:41:26 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:26 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6" returned: 0 in 0.506s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:26 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6 Apr 10 10:41:26 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:26 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f" returned: 0 in 0.579s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:26 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:27 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f Apr 10 10:41:27 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "cinder-921c175c-d652-49e6-80b0-2e682fee64b1-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-921c175c-d652-49e6-80b0-2e682fee64b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "cinder-quobyte-79495af2-00c7-41bf-a308-b5fc9fb545f4" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-79495af2-00c7-41bf-a308-b5fc9fb545f4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "cinder-quobyte-921c175c-d652-49e6-80b0-2e682fee64b1" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-921c175c-d652-49e6-80b0-2e682fee64b1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Deleting offline snapshot 921c175c-d652-49e6-80b0-2e682fee64b1 of volume 79495af2-00c7-41bf-a308-b5fc9fb545f4 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] snapshot_file for this snap is: volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c54bcdd-0701-4ff0-8e14-f6b7a62679f5]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:27 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 1G" returned: 0 in 0.603s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c039062-9d96-45bb-a9ea-6a607febb900 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:27 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 Apr 10 10:41:27 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:27 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c039062-9d96-45bb-a9ea-6a607febb900 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 Apr 10 10:41:27 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:27 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-2dd75232-a453-4426-b855-f3e0068ad1d6" returned: 0 in 0.528s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-quobyte-2dd75232-a453-4426-b855-f3e0068ad1d6" released by "delete_volume" :: held 1.066s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:27 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-a0e6d9fc-100c-4493-8d58-ebc9aaef095f" returned: 0 in 0.524s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Created reservations ['1c0c8d8f-6e6b-4c51-a86a-56868a45e150', '36f80d04-c672-47bc-9a73-4f0f5fcd6ca9', 'e367e4b0-befb-42d3-ba71-abeb06a61e4b', 'b6eccae1-f5d4-4f56-a956-b3dbace0ecd5'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-a0e6d9fc-100c-4493-8d58-ebc9aaef095f" released by "delete_volume" :: held 1.133s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created reservations ['81cb2de5-e44c-487a-b22b-bc9e7e11181d', '923b00df-8db1-4ca5-ad3c-8cc7c082af32', '73f4d540-c4a2-456b-823b-37c691d18c6d', '93c02f9e-8bd8-42d4-a3ee-d4007fa578b1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:27 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:27 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:27 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:27 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:27 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c039062-9d96-45bb-a9ea-6a607febb900 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528" returned: 0 in 0.477s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:27 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 is being set with open permissions: ugo+rw Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:27 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 Apr 10 10:41:27 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:27 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1" returned: 0 in 0.585s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79495af2-00c7-41bf-a308-b5fc9fb545f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5753debf-1b14-401f-b492-9c597450ede9]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:27 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:28 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 Apr 10 10:41:28 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:28 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.486s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Deleted volume successfully. Apr 10 10:41:28 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.465s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-de11ea3a-1795-4aa3-981a-4888ed04a59e tempest-CreateVolumesFromSnapshotTest-1901461355 None] Lock "cinder-2dd75232-a453-4426-b855-f3e0068ad1d6-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:28 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Deleted volume successfully. Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-47d7e296-073f-4b6f-b04b-eeaaf4acef8d tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-a0e6d9fc-100c-4493-8d58-ebc9aaef095f-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:28 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528" returned: 0 in 0.469s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:28 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.info Apr 10 10:41:28 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-262f1eb3-8823-44bc-9c07-aac7834ec86a-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-262f1eb3-8823-44bc-9c07-aac7834ec86a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-quobyte-262f1eb3-8823-44bc-9c07-aac7834ec86a" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-262f1eb3-8823-44bc-9c07-aac7834ec86a" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:28 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4" returned: 0 in 0.599s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3070de-8c1a-4b8b-9245-ee5ac7d64d64]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:28 devstack sudo[91057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 Apr 10 10:41:28 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:28 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a Apr 10 10:41:28 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:28 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.info" returned: 0 in 0.587s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:28 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.info is being set with open permissions: ugo+rw Apr 10 10:41:28 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:29 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.info Apr 10 10:41:29 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:29 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1" returned: 0 in 0.704s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:29 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1 Apr 10 10:41:29 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:29 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a" returned: 0 in 0.750s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:29 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a Apr 10 10:41:29 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:29 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.info" returned: 0 in 0.714s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-quobyte-f5fb2749-ef54-4a04-9a1b-126b72f6aa49" by "_copy_volume_from_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-f5fb2749-ef54-4a04-9a1b-126b72f6aa49" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] snapshot: 835a5bc7-f277-4909-b02d-26d108020528, volume: f5fb2749-ef54-4a04-9a1b-126b72f6aa49, {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a63755-ef1a-48de-9e18-4c8963e2956f]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:29 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 Apr 10 10:41:29 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:29 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-262f1eb3-8823-44bc-9c07-aac7834ec86a" returned: 0 in 0.572s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-262f1eb3-8823-44bc-9c07-aac7834ec86a" released by "delete_volume" :: held 1.386s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:29 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created reservations ['ecaddb06-9071-40c1-8b20-cf5d6d8b8c31', '5d557e3b-0b31-45da-9931-b9841999c206', '65df1e33-69b8-4a02-95d1-9107d19b4496', '81f055ec-5fc8-43f6-965a-5673715a0a46'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:30 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:30 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:30 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4.921c175c-d652-49e6-80b0-2e682fee64b1" returned: 0 in 0.824s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-921c175c-d652-49e6-80b0-2e682fee64b1" released by "_delete_snapshot" :: held 2.788s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-79495af2-00c7-41bf-a308-b5fc9fb545f4" released by "delete_snapshot" :: held 2.805s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Created reservations ['404fda9b-e0d5-41a2-87e0-a2020fcf0466', '7c688383-3bb3-4aca-88c1-88f3928d7bf1', 'ed69a806-8987-40c4-8ff3-a382eedf439e', 'f9d4dcad-9b01-426f-a6c1-53b334833ee1'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Delete snapshot completed successfully. Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-da3decfd-49ff-4186-bfb6-2bd56f765f7d tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-921c175c-d652-49e6-80b0-2e682fee64b1-delete_snapshot" released by "delete_snapshot" :: held 2.936s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:30 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528" returned: 0 in 0.639s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c039062-9d96-45bb-a9ea-6a607febb900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Creating direct copy from snapshot {{(pid=83037) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff380695-6b4f-4606-8316-55615f1bcec9]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "cinder-79495af2-00c7-41bf-a308-b5fc9fb545f4-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-79495af2-00c7-41bf-a308-b5fc9fb545f4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:30 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 Apr 10 10:41:30 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "cinder-quobyte-79495af2-00c7-41bf-a308-b5fc9fb545f4" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-79495af2-00c7-41bf-a308-b5fc9fb545f4" acquired by "delete_volume" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[9273f081-6486-48b5-a91e-269e6eb9063a]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:30 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.518s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:30 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Deleted volume successfully. Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-59f33214-842f-49a6-9d24-b277afde1e31 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-262f1eb3-8823-44bc-9c07-aac7834ec86a-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:30 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 Apr 10 10:41:30 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-946f6104-ec42-4aff-b242-62aeca4f40a6-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-946f6104-ec42-4aff-b242-62aeca4f40a6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-quobyte-946f6104-ec42-4aff-b242-62aeca4f40a6" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-946f6104-ec42-4aff-b242-62aeca4f40a6" acquired by "delete_volume" :: waited 0.017s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9644e2d-64bf-463e-b9a7-115a6c11b714]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:30 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6 Apr 10 10:41:30 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:30 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900" returned: 0 in 0.555s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG cinder.utils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Path /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 not found in is_blk_device check {{(pid=83037) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:41:30 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:30 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 Apr 10 10:41:30 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:31 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4" returned: 0 in 0.541s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:31 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4 Apr 10 10:41:31 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:31 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6" returned: 0 in 0.497s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:31 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6 Apr 10 10:41:31 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:31 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-79495af2-00c7-41bf-a308-b5fc9fb545f4" returned: 0 in 0.469s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-79495af2-00c7-41bf-a308-b5fc9fb545f4" released by "delete_volume" :: held 1.052s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Created reservations ['0e02b685-e7cc-45a2-8279-d0f59b6faead', '5a456df3-a24b-46c0-aadd-2f9ee9be64d9', 'c1c9f4a7-7307-4b39-bddb-e75b6d61940a', 'ffeffbda-2cd0-458d-a90c-4b74980cfbe9'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:31 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:31 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:31 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:32 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-946f6104-ec42-4aff-b242-62aeca4f40a6" returned: 0 in 1.236s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-946f6104-ec42-4aff-b242-62aeca4f40a6" released by "delete_volume" :: held 1.762s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:32 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created reservations ['e2974c79-e876-4474-8955-2086282973ff', '9cd8a6aa-cae8-48e8-982f-b43daea541e3', '1b872039-5489-4556-96a6-6f23353e9ce5', 'ac7313a7-8240-4380-8554-b8c1f0910213'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:32 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:32 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "cinder-463ae8e3-cd25-4b3d-8e03-648058cfe1ed-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:32 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:32 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:32 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-463ae8e3-cd25-4b3d-8e03-648058cfe1ed-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-86b9de6d-22e5-466d-8713-846d70e246c2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-86b9de6d-22e5-466d-8713-846d70e246c2-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "cinder-quobyte-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "cinder-quobyte-86b9de6d-22e5-466d-8713-846d70e246c2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" acquired by "delete_volume" :: waited 0.024s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-86b9de6d-22e5-466d-8713-846d70e246c2" acquired by "delete_volume" :: waited 0.026s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d04e9-2d23-4268-99c4-f702e6c5c8fc]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bb7036-2be6-4ab9-8d82-fd558e2c1cf3]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:33 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 1.413s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Deleted volume successfully. Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8c5456c1-a734-4377-a1a4-2369fe1d7589 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-79495af2-00c7-41bf-a308-b5fc9fb545f4-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:33 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed Apr 10 10:41:33 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:33 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49" returned: 0 in 2.455s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:33 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2 Apr 10 10:41:33 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff122be-7165-48b7-b203-06a012d996aa]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:33 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 Apr 10 10:41:33 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:33 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.866s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:33 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Deleted volume successfully. Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2507aa2f-a542-4665-994d-090ad1382b5c tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-946f6104-ec42-4aff-b242-62aeca4f40a6-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:33 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" returned: 0 in 0.574s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:33 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed Apr 10 10:41:33 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:33 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2" returned: 0 in 0.606s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:33 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:33 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2 Apr 10 10:41:33 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:34 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900" returned: 0 in 0.673s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.image.image_utils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Image conversion details: src /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 {{(pid=83037) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:41:34 devstack cinder-volume[83037]: INFO cinder.image.image_utils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Converted 1024.00 MB image at 416.97 MB/s Apr 10 10:41:34 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 is being set with open permissions: ugo+rw Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:34 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 Apr 10 10:41:34 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:34 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" returned: 0 in 0.435s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-quobyte-463ae8e3-cd25-4b3d-8e03-648058cfe1ed" released by "delete_volume" :: held 1.056s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Created reservations ['e580c5da-20ac-408a-b25f-d9cacba4ae2f', 'e86fcb55-98c2-4e5e-90fd-be304691d4e6', 'bde05041-0ac7-44ea-a3cf-3fd5df97aa78', '1a5bd7df-0713-4401-96b9-559ab3f3e8cf'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:34 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-86b9de6d-22e5-466d-8713-846d70e246c2" returned: 0 in 0.472s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-quobyte-86b9de6d-22e5-466d-8713-846d70e246c2" released by "delete_volume" :: held 1.140s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:34 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:34 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Created reservations ['9d32a8cd-adf4-44f5-a212-bf1536e3b631', '897a2f2f-0bed-4c24-9e4b-6f8ffa26aed2', '4786e03f-619a-4328-85c9-618d5f8b46d1', 'f875ba16-75a3-480c-be90-318641c51fcf'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:34 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:34 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:34 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49" returned: 0 in 0.445s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-f5fb2749-ef54-4a04-9a1b-126b72f6aa49" released by "_copy_volume_from_snapshot" :: held 4.828s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-quobyte-835a5bc7-f277-4909-b02d-26d108020528" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-835a5bc7-f277-4909-b02d-26d108020528" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Deleting offline snapshot 835a5bc7-f277-4909-b02d-26d108020528 of volume 7c039062-9d96-45bb-a9ea-6a607febb900 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] snapshot_file for this snap is: volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea89c683-3ddd-4105-adbe-2e51d6975af1]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:34 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 Apr 10 10:41:34 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:34 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.475s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:34 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Deleted volume successfully. Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-2dde20c7-d162-4f0b-aecc-b9b851b81593 tempest-SnapshotDependencyTests-2088693929 None] Lock "cinder-463ae8e3-cd25-4b3d-8e03-648058cfe1ed-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:34 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:34 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Deleted volume successfully. Apr 10 10:41:34 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-8883bc69-d29f-47b4-9711-da00b1fc1691 tempest-CreateVolumesFromSourceVolumeTest-862643643 None] Lock "cinder-86b9de6d-22e5-466d-8713-846d70e246c2-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:35 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528" returned: 0 in 0.543s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:35 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c039062-9d96-45bb-a9ea-6a607febb900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:35 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc704869-f0c6-4824-8064-50fdbf673c97]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:35 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 Apr 10 10:41:35 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:35 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900" returned: 0 in 0.643s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:35 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:35 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 Apr 10 10:41:35 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:36 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528" returned: 0 in 0.583s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:36 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528 Apr 10 10:41:36 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:36 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:36 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900.835a5bc7-f277-4909-b02d-26d108020528" returned: 0 in 0.602s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:36 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-835a5bc7-f277-4909-b02d-26d108020528" released by "_delete_snapshot" :: held 2.428s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.807s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f84f8f-e436-493a-9c41-08560893a59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49', 'volume_size': 1, 'source_volid': '7c039062-9d96-45bb-a9ea-6a607febb900', 'source_volstatus': 'available'}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0548969-37c7-44e4-8595-5db095fac070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:37 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Volume volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 (f5fb2749-ef54-4a04-9a1b-126b72f6aa49): created successfully Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0548969-37c7-44e4-8595-5db095fac070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Flow 'volume_create_manager' (9a530ce6-02a3-45db-a99a-44fae7a8aa52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:37 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ca08d7d6-aa7a-4efd-8a03-cbd377d08352 tempest-VolumeDependencyTests-613899977 None] Created volume successfully. Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Flow 'volume_create_manager' (1c58d9fc-0b3d-426c-b959-9b01f78751b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac57a83-d75c-408d-9c0c-829250af0935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac57a83-d75c-408d-9c0c-829250af0935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537bae63-d279-4713-895e-8d280aaad4f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6b7fa4afa24c01b00efb8e79838e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:37Z,use_quota=True,user_id='fcf9e324af604b4e83ba39f4a81abc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18b1981-ec70-4c25-b023-7c52c4054c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18b1981-ec70-4c25-b023-7c52c4054c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d628ade9-b567-46a9-a9b9-68d7ee24d1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d628ade9-b567-46a9-a9b9-68d7ee24d1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '537bae63-d279-4713-895e-8d280aaad4f2', 'volume_name': 'volume-537bae63-d279-4713-895e-8d280aaad4f2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a28485-5372-4f77-a69f-f15e15acdece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a28485-5372-4f77-a69f-f15e15acdece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89aec7b-326f-4103-b57b-1d8dee3efcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:37 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Volume 537bae63-d279-4713-895e-8d280aaad4f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-537bae63-d279-4713-895e-8d280aaad4f2', 'volume_size': 1} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537bae63-d279-4713-895e-8d280aaad4f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6b7fa4afa24c01b00efb8e79838e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:37Z,use_quota=True,user_id='fcf9e324af604b4e83ba39f4a81abc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Creating volume 537bae63-d279-4713-895e-8d280aaad4f2 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:37 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:37 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2 1073741824 Apr 10 10:41:37 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-7c039062-9d96-45bb-a9ea-6a607febb900-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-7c039062-9d96-45bb-a9ea-6a607febb900-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-quobyte-7c039062-9d96-45bb-a9ea-6a607febb900" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-7c039062-9d96-45bb-a9ea-6a607febb900" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0941a4-b6d8-430e-a66a-325a95482aef]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:37 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 Apr 10 10:41:37 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:37 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2 1073741824" returned: 0 in 0.606s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:37 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2 Apr 10 10:41:37 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:37 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900" returned: 0 in 0.550s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:37 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:38 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900 Apr 10 10:41:38 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:38 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2" returned: 0 in 0.559s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89aec7b-326f-4103-b57b-1d8dee3efcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537bae63-d279-4713-895e-8d280aaad4f2', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523f0979-d4f7-4c6e-aa9d-8a6cac37575f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:38 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Volume volume-537bae63-d279-4713-895e-8d280aaad4f2 (537bae63-d279-4713-895e-8d280aaad4f2): created successfully Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523f0979-d4f7-4c6e-aa9d-8a6cac37575f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Flow 'volume_create_manager' (1c58d9fc-0b3d-426c-b959-9b01f78751b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:38 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-08300621-7465-4416-98a3-ecdfbad05df5 tempest-CinderUnicodeTest-1658281535 None] Created volume successfully. Apr 10 10:41:38 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-7c039062-9d96-45bb-a9ea-6a607febb900" returned: 0 in 0.540s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-7c039062-9d96-45bb-a9ea-6a607febb900" released by "delete_volume" :: held 1.127s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Created reservations ['6d0ea6df-d1b1-4537-8b36-165cd67ba7c5', 'd1c423ce-7115-4b72-95de-44d0e0f756b9', '28b6b54f-fa18-4475-b0e7-e4a1abf8bd6c', '9f07f5eb-df70-4b98-8f1e-6afe03e7f9a5'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:38 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:38 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:38 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:39 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.443s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:39 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Deleted volume successfully. Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ae3ac418-1176-4afd-9fca-f47e329a88e1 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-7c039062-9d96-45bb-a9ea-6a607febb900-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-f5fb2749-ef54-4a04-9a1b-126b72f6aa49-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-f5fb2749-ef54-4a04-9a1b-126b72f6aa49-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-quobyte-f5fb2749-ef54-4a04-9a1b-126b72f6aa49" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-f5fb2749-ef54-4a04-9a1b-126b72f6aa49" acquired by "delete_volume" :: waited 0.021s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83037) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Flow 'volume_create_manager' (a099d27d-0f00-4dfe-b5c8-64bbdc6883ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1cb4e9-247c-4745-86bf-53bde8b1731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[0739071a-ec1c-4fad-98e3-4dc8e3d3b9a7]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1cb4e9-247c-4745-86bf-53bde8b1731f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-522617335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c560e9ca-84fd-4e71-8e7b-48ef91a854d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6b7fa4afa24c01b00efb8e79838e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:40Z,use_quota=True,user_id='fcf9e324af604b4e83ba39f4a81abc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a00269-f9b1-40e2-af7d-7f66501e03fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a00269-f9b1-40e2-af7d-7f66501e03fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0a61ca-7df1-4ee2-b7ca-b8bf74cddcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0a61ca-7df1-4ee2-b7ca-b8bf74cddcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c560e9ca-84fd-4e71-8e7b-48ef91a854d1', 'volume_name': 'volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d633375-beb1-42d6-a18d-7d592ca6250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d633375-beb1-42d6-a18d-7d592ca6250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b72ed40-e30c-44b3-8994-8314826d5f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:39 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Volume c560e9ca-84fd-4e71-8e7b-48ef91a854d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1', 'volume_size': 1} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-522617335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c560e9ca-84fd-4e71-8e7b-48ef91a854d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e6b7fa4afa24c01b00efb8e79838e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:40Z,use_quota=True,user_id='fcf9e324af604b4e83ba39f4a81abc63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ebc954-3831-43bb-9701-9705f3a06412),volume_type_id=52ebc954-3831-43bb-9701-9705f3a06412)}" {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Creating volume c560e9ca-84fd-4e71-8e7b-48ef91a854d1 {{(pid=83037) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Selected osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac as target Quobyte volume. {{(pid=83037) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:39 devstack cinder-volume[83037]: INFO cinder.volume.drivers.remotefs [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] casted to osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac Apr 10 10:41:39 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 1073741824 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:39 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 Apr 10 10:41:39 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:39 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 1073741824 Apr 10 10:41:39 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:40 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49" returned: 0 in 0.562s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:40 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49 Apr 10 10:41:40 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:40 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 1073741824" returned: 0 in 0.569s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:40 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 Apr 10 10:41:40 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:40 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-f5fb2749-ef54-4a04-9a1b-126b72f6aa49" returned: 0 in 0.527s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-f5fb2749-ef54-4a04-9a1b-126b72f6aa49" released by "delete_volume" :: held 1.135s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Created reservations ['d1301a35-54f9-4d51-83b8-552cbab079cf', '5990d69f-93b8-40c5-9c0d-873e6c01daf8', '3389f5a4-3b96-443f-9f8d-eb2a4e46dea1', '9965084b-0c79-46f2-80e4-c7d921b8c8c8'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:40 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1" returned: 0 in 0.515s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'} {{(pid=83037) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b72ed40-e30c-44b3-8994-8314826d5f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1', 'volume_size': 1}' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f2f439-aa92-4446-a913-75306eb25bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:40 devstack cinder-volume[83037]: INFO cinder.volume.flows.manager.create_volume [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Volume volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 (c560e9ca-84fd-4e71-8e7b-48ef91a854d1): created successfully Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f2f439-aa92-4446-a913-75306eb25bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83037) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Flow 'volume_create_manager' (a099d27d-0f00-4dfe-b5c8-64bbdc6883ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83037) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:40 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:40 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-a7ba9839-fa5e-426f-8529-30b676dba9e4 tempest-CinderUnicodeTest-1658281535 None] Created volume successfully. Apr 10 10:41:40 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:40 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:41 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.455s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:41 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:41 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Deleted volume successfully. Apr 10 10:41:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-b8421868-c594-450a-9475-99089c4b8956 tempest-VolumeDependencyTests-613899977 None] Lock "cinder-f5fb2749-ef54-4a04-9a1b-126b72f6aa49-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-d08a9a75-e8e9-40b5-97df-f18b868d3b5f-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Lock "cinder-d08a9a75-e8e9-40b5-97df-f18b868d3b5f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Acquiring lock "cinder-quobyte-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:41 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" acquired by "delete_volume" :: waited 0.011s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:41 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f667cf0-b072-4069-bf49-6792971f4bdf]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:41 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:42 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] Creating offline snapshot 520e6285-b4e1-4488-9b89-9709dbe78a1f of volume c560e9ca-84fd-4e71-8e7b-48ef91a854d1 {{(pid=83037) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:41:42 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e875f84b-09d9-4635-9da0-b309488d67f0]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:42 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f Apr 10 10:41:42 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:42 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 Apr 10 10:41:42 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:42 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" returned: 0 in 0.558s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:42 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f Apr 10 10:41:42 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:42 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1" returned: 0 in 0.602s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f 1G {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:42 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f 1G Apr 10 10:41:42 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:42 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:42 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" returned: 0 in 0.468s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:42 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Lock "cinder-quobyte-d08a9a75-e8e9-40b5-97df-f18b868d3b5f" released by "delete_volume" :: held 1.065s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Created reservations ['29e6ffe4-274d-4f8c-a4b7-8b239e1b718a', 'e1349202-6d33-4049-8750-ce8ec767b336', 'b1b3221a-6503-4b58-8548-7bc7eb68c4ba', '8d1937f3-c4f5-45ae-b4fa-5103d72be051'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:43 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:43 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:43 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f 1G" returned: 0 in 0.592s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:43 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f Apr 10 10:41:43 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:43 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.454s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:43 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Deleted volume successfully. Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-893fd2d6-36ba-4706-9ba2-a891096f06ca tempest-VolumeDependencyTests-613899977 None] Lock "cinder-d08a9a75-e8e9-40b5-97df-f18b868d3b5f-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:43 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 -F qcow2 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f" returned: 0 in 0.466s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:43 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f is being set with open permissions: ugo+rw Apr 10 10:41:43 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:43 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f Apr 10 10:41:43 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:44 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f" returned: 0 in 0.433s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:44 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.info Apr 10 10:41:44 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:44 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.info" returned: 0 in 0.507s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:44 devstack cinder-volume[83037]: WARNING cinder.volume.drivers.remotefs [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.info is being set with open permissions: ugo+rw Apr 10 10:41:44 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.info {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:44 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.info Apr 10 10:41:44 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:45 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.info" returned: 0 in 0.525s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:45 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.186s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:45 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-c8a14a91-55f8-40c7-bdcb-8237564e63bb tempest-CinderUnicodeTest-1658281535 None] Create snapshot completed successfully Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "cinder-520e6285-b4e1-4488-9b89-9709dbe78a1f-delete_snapshot" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-520e6285-b4e1-4488-9b89-9709dbe78a1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "cinder-quobyte-c560e9ca-84fd-4e71-8e7b-48ef91a854d1" by "delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-quobyte-c560e9ca-84fd-4e71-8e7b-48ef91a854d1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "cinder-quobyte-520e6285-b4e1-4488-9b89-9709dbe78a1f" by "_delete_snapshot" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-quobyte-520e6285-b4e1-4488-9b89-9709dbe78a1f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Deleting offline snapshot 520e6285-b4e1-4488-9b89-9709dbe78a1f of volume c560e9ca-84fd-4e71-8e7b-48ef91a854d1 {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] snapshot_file for this snap is: volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f {{(pid=83037) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a9446-1046-4211-8d36-275648041993]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:46 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f Apr 10 10:41:46 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:46 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f" returned: 0 in 0.461s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.remotefs [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83037) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[f514efc6-50ad-48a0-a06c-09019044a39c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:46 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:46 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 Apr 10 10:41:46 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:47 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1" returned: 0 in 0.466s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:47 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f Apr 10 10:41:47 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:47 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f" returned: 0 in 0.451s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:47 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:47 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f Apr 10 10:41:47 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:48 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1.520e6285-b4e1-4488-9b89-9709dbe78a1f" returned: 0 in 0.438s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-quobyte-520e6285-b4e1-4488-9b89-9709dbe78a1f" released by "_delete_snapshot" :: held 1.873s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-quobyte-c560e9ca-84fd-4e71-8e7b-48ef91a854d1" released by "delete_snapshot" :: held 1.887s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Created reservations ['c05f62a2-77ec-48bd-9c54-b440dfada77d', 'eb28c4d4-4ed2-456c-8fe6-66a7dfb2bc65', '0dc2f161-a410-42da-8e0e-217801c47824', 'f5c2e080-7fd0-4307-95a7-b3b641d3dc18'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:48 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Delete snapshot completed successfully. Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-ab5113c0-d2b7-4acb-9835-e8a0dd63b547 tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-520e6285-b4e1-4488-9b89-9709dbe78a1f-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "cinder-c560e9ca-84fd-4e71-8e7b-48ef91a854d1-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-c560e9ca-84fd-4e71-8e7b-48ef91a854d1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "cinder-quobyte-c560e9ca-84fd-4e71-8e7b-48ef91a854d1" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-quobyte-c560e9ca-84fd-4e71-8e7b-48ef91a854d1" acquired by "delete_volume" :: waited 0.009s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f7033c-12a3-46de-82e4-b0346c10877c]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:48 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 Apr 10 10:41:48 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:48 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1" returned: 0 in 0.458s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:48 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:48 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1 Apr 10 10:41:48 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:49 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-c560e9ca-84fd-4e71-8e7b-48ef91a854d1" returned: 0 in 0.403s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-quobyte-c560e9ca-84fd-4e71-8e7b-48ef91a854d1" released by "delete_volume" :: held 0.897s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Created reservations ['ca9d10dd-2f6e-4822-9558-c9f8c4b1a78f', '5f9b4f2f-84a0-4e43-bc82-618e6020c42f', '37f9d156-f4ac-489c-a611-fd2c4fffbb13', 'd98fd7c1-3684-4e9d-8849-e6a82d0122fe'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:49 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:49 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "cinder-537bae63-d279-4713-895e-8d280aaad4f2-delete_volume" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-537bae63-d279-4713-895e-8d280aaad4f2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "cinder-quobyte-537bae63-d279-4713-895e-8d280aaad4f2" by "delete_volume" {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-quobyte-537bae63-d279-4713-895e-8d280aaad4f2" acquired by "delete_volume" :: waited 0.007s {{(pid=83037) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG oslo.privsep.daemon [-] privsep: reply[e728d31b-6d1b-472a-80cc-31a6200e86c3]: (4, 'qcow2') {{(pid=83755) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:49 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2 Apr 10 10:41:49 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:49 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.466s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:49 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Deleted volume successfully. Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-343842fa-40bf-4845-908c-448e27560d92 tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-c560e9ca-84fd-4e71-8e7b-48ef91a854d1-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:49 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2" returned: 0 in 0.477s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:49 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:49 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2 Apr 10 10:41:49 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:50 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49/volume-537bae63-d279-4713-895e-8d280aaad4f2" returned: 0 in 0.404s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-quobyte-537bae63-d279-4713-895e-8d280aaad4f2" released by "delete_volume" :: held 0.900s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG cinder.quota [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Created reservations ['709ba6bf-bce4-4d2a-b513-20608d9f0ef1', 'c0575085-3193-4f59-a23d-4e5b7d672635', '8c1abe5a-fb44-4d35-8be2-594cb4c25979', 'd01028b7-e440-4de6-9aae-40f541dcbad6'] {{(pid=83037) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:50 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:50 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:50 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.472s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:50 devstack cinder-volume[83037]: INFO cinder.volume.manager [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Deleted volume successfully. Apr 10 10:41:50 devstack cinder-volume[83037]: DEBUG cinder.coordination [None req-dd3dd89c-2845-4e62-b7a8-49aed69bf10c tempest-CinderUnicodeTest-1658281535 None] Lock "cinder-537bae63-d279-4713-895e-8d280aaad4f2-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=83037) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:57 devstack cinder-volume[83037]: DEBUG oslo_service.periodic_task [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83037) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:41:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac': None} {{(pid=83037) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:57 devstack cinder-volume[83037]: DEBUG cinder.volume.drivers.quobyte [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-96bf8b38-fd73-446a-8102-c34e2b5350ac'] {{(pid=83037) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.lockutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83037) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:57 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:57 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49 Apr 10 10:41:57 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:58 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:58 devstack cinder-volume[83037]: DEBUG oslo_concurrency.processutils [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9481d9c67b86fd47bf2e6166a318db49" returned: 0 in 0.504s {{(pid=83037) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:58 devstack cinder-volume[83037]: DEBUG cinder.manager [None req-4625733f-95a6-4bbe-9301-e623c178c3bd None None] Notifying Schedulers of capabilities ... {{(pid=83037) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:58 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:INSERT=59,cinder:UPDATE=276,cinder:SELECT=196,cinder:DELETE=25 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:41:58 devstack cinder-volume[83037]: DEBUG dbcounter [-] [83037] Writing DB stats cinder:SELECT=175,cinder:UPDATE=256,cinder:INSERT=72,cinder:DELETE=19 {{(pid=83037) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}